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1-0  IHTHODUCTIOK 


1.1  Scope  find  Structure  pf  Report: 

The  primary  purpose  of  the  present  rest Arch  has  been  to  deatmatreta  the 
feasibility  of  nie signing  intelligent  system*  with  the  capacity  for  adaptive, 
flexible  reasoning  in  uncertain  and  changing  environ:" eats .  The  overall  goals 
of  the  project  are  (1)  the  development  of  innovative  inference  frameworks  for 
Feaaoniii^j  in  avionics  environments  characterized  by  high  stakes,  large  volumes 
of  complex  and  conflicting  Information,  and  the  need  for  rapid  response;  end 
(2)  to  lay  the  groundwork  for  a  more  general  understanding  of  the  process  of 
choosing  and  de signing  inference  frameworks  for  avionios  expert  systems 
applications.  The  achievement  of  these  objectives  would  have  far-reaching  im¬ 
plications  for  the  successful  application  of  artificial  intelligence  technol¬ 
ogy  in  both  military  and  civilian  contexts,  allowing  the  development  of  sys¬ 
tems  which  fully  exploit,  while  significantly  improving  upon,  human  intel¬ 
ligent  reasoning.  The  ultimate  result  should  be  improved  petfotmande ,  at  con- 
patatiwoly  little  cost,  of  4  wide  tango  of  combat  systefflt. 

This  report  details  the  contributions  of  the  initial  phase  of  this  frasearch. 
The  remainder  of  this  introductory  section  provides  background  on  the  problem 
and  briefly  si,miniati*oi  Specific  objectives,  Sections  2  through  5  report  on 
Che  results.  Section  2  Is  *  critical  review  of  alternative  inference 
theorie*.  The  review  highlights  the  shortcomings  of  current  approaches  in 
providing  fully  adequate  representations  of  uncertainty,  and  fully  anjequate 
technique*  for  adaptively  manipulating  uncertain  beliefs.  Section  3  describes 
the  main  product  of  the  effort,  an  iontivetive  framework  for  expert  system  in¬ 
fo  ftpec  tn  Uncertain  domain*.  Section  4  describe*  the  application  of  char  in¬ 
ference  fraraeWorlt  to  an  Air  Fuith;*  combat  environtMULt  in  e  sftall-*cal* 
prototype  xysttun  for  in- flight  route  replanning,  Section  5  describes  a  eofa- 
plementary  lino  of  research  on  concepts  for  human- computer  interaction,  and 
discusses  their  application  in  the  prototype  iyitetn.  Section  6  *unnmai: it « s  the 
work  and  briefly  explores  direction*  for  ehe  future . 
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1 . 2  Background _pn  the  Problem 


In  recant  years  techniques  of  artificial  intelligence  (A I  )  have  been  employed 
to  replicate,  or  improve  on,  human  reasoning  in  an  increasing  sphere  of  in¬ 
ference  and  decision-making  tasks  fHayes-Roch  et  al.,  1963;  Buchanan  and  Duda, 
19S2) .  Expert  systems  have  now  been  developed  for  medical  diagnosis  and 
treatment  (e.g.,  Short liffe,  1976],  geological  exploration  (e.g,T  Dud a  et  al. , 
1979),  chemical  analysis  (Lindsay  et  al.  ,  19S0) ,  military  planning  (Engleman 
et  al,  ,  19791,  ai'.d  other  areas  of  specialized  human  skill. 

Unfortunately,  the  introduction  of  AT  technologies  into  real-time  tactical  en¬ 
vironments  has  been  relatively  slow.  Among  the  reasons  for  lack  of  progress 
are  a  set  of  technical  obstacles  arising  largely  from  the  complexity  of  the 
inference  task  in  these  problem  domains  r  (1)  Hear -future  avionics  environ¬ 
ments  will  be  characterized  by  high  Stakes  and  increasing  numbers  of  high  per¬ 
formance  threats  both  in  the  air  and  on  the  ground,  heightening  both  the  time 
pressure  and  the  uncertainty  Under  which  systems  must  function.  Avionics 
decision  aids  must  Support  real-time,  decisions  In  rapidly  changing 
environments,  while  utilising  data  sets  which  are  Large,  incomplete, 
unrs 1 table ,  and  often  inconsistent.  (2)  In  air-to-air  and  air- to- ground 
combat,  Conflicts  between  critical  objectives  occur  frequently  and  must  be 
resolved.  E.g.,  the  requirements  to  communicate  with  other  units,  to  localize 
threats  by  means  of  active  emissions,  or  to  move  into  proximity  to  a  potential 
target  all  may  conflict  with  the  goal  of  concealing  one's  presence  and 
location.  (1)  New  advances  in  avionics  technology  have  often  led  to  the  in¬ 
troduction  of  "black  hexes"  which  are  poorly  Integrated  with  other  hardware  or 
software  components,  and  whose  displays  and  control a  are  incompatible.  Future 
systems  therefore  will  Involve  exchange  of  output a  among  subsystems  which 
utilize  radically  different  methods  of  representation  and  inference,  e.g., 
rule -based  architectures  for  predicting  threat  capabilities  versus  mathemati¬ 
cal  or  statistical  techniques  of  signal  analysis,  and  must  utilize  a  common 
set  of  user -system  dialogue  procedures.  (4)  In  theae  environments  human 
abilities  to  deal  with  unanticipated  events,  or  ill- defined  concepts,  may  be 
crucial.  To  obtain  true  synergy  between  human  and  computer  capabilities,  the 
aid  must  permit  a  dynamic  and  flexible  partitioning  of  reasoning  task  com¬ 
ponents  between  human  and  computer,,  he  able  to  communicate  both  the  decree  of 
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confidence  and  the  rationale  behind  its  recommendations  ,  and  facilitate  Intel' 
ligent  over  tide  at  Any  point  In  the  reasoning  prucusfl  , 


In  Cfcetlt  years  ,  Serious  attention  has  turned  in  the  Al/expart  systems  con- 
munity  to  the  problem  of  reasoning  about  uncertainty  (c.g..  Sectarian  and 
ShortlLffc,  19(54) i  and  tentative  theoretical  steps  have  been  made  toward 
flexible  systems  capable  of  adaptive  learning  (e.g,,  Hichaleki  et  el.,  1943), 
Nevertheless,  current  expert  systems  technology  ha*  for  the  nest  part  failed 
to  capture  the  Capability  of  raAny  domain  experts  to  respond  adaptively  and 
flexibly  to  conditions  which  violate  the  original  assumption*,  to  create  n*u 
anethod*  of  reasoning  where  required,  and  to  develop  new  ways  of  orgsnlting 
dote  And  £*1 letting  information  based  an  unanticipated  events.  An  adaptive 
capability  of  this  sort  is  required  In  order  tC  build  systems  tbat  Address  the 
challenges  of  the  modern  battlefield, 

L'e  believe  that  a  significant  opportunity  for  addressing  these  shortcomings 
exists  in  recent  work  on  inexact  reasoning  in  artificial  intelligence  and  in 
statistics . 

The  design  of  methods  for  inexact  reasoning  has  in.  the  past  several  years 
moved  from,  the  background  into  the  forefront  of  attention  in  expert  system, 
research,  and  in  A£  more  generally.  In  addition  to  the  ad  hoc  numeric  methods 
developed  in  such  early  systems  be  HYGIN  and  PROSPECTOR,  a  variety  of  formally 
justified  quantitative  approaches  aft  now  being  discussed  and  imp lecente d . 
Among  the  moat  prominent  ate  variants  of  Bayesian  probability  theory,  belief 
functions  (Shafer,  1976),  and  fuzzy  set  or  possibility  theory  (Zadeh,  1965, 
1972).,  Hoimumer leal  approaches  to  reasoning  with  incomplete  information  have 
also  been  developed.,  and  are  perhaps  closer  to  the  mainstream  Al  tradition  of 
symbolic  reasoning]  e.g, ,  turn- mono  tonic  logic  (Doyle,  1979;  Artificial  Intel¬ 
ligence  (special  issue),  19B0)  ;  and  the  theory  of  endorsements  (Cohen,  19E5). 
Although  there  have  been  a  few  attempts  (e.g.,  Nilsson,  1934;  Ginsberg,  1934; 
Cohen,  1995)  to  Integrate  the  numeric  and  non-numeric  traditions,  for  the  most 
part  they  Slave  regained  separate, 

Uncertainty  calculi  will  eventually  he  Judged  by  how  successfully  they  con¬ 
tribute  to  a  variety  of  expert  system  functions;  for  example;  (1)  deriving 
the  uncertainty  of  a  conclusion  from  uncertainty  in  data  ond  rules  across 
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potentially  lengthy  lines  of  reasoning;  { 2 )  combining  different  Items  of 
evidence  or  outputs  of  different  analytical  subsystems;  (1)  resolving  con¬ 
flicts  between  different  lines  of  reasoning.  {e.g.p  hy  collecting,  more  informa¬ 
tion  or  by  revising  assumptions) ;  and  w  displaying  conclusion*, 
explanations r  and  measures  of  confidence  to  users  in  ways  that  are  readily 
understood.  In  time -stressed  environments  additional  functions  may  include ; 

(5)  efficient  allocation  of  resources  among  different  line*  af  reasoning  or 
Information  collection  options,  (t)  halting  computations  when  results  are 
"acceptable  enough"  In  the  light  of  prevailing  time  and  resource  constraints. 

Unfortunately,  no  current  sy sterna  effectively  et»co®pass  these  diverse 
capabilities.  Moreover,,  there  has  as  yet  been  little  systematic  investigation 
of  the  impact  of  alternative  inference  frameworks  on  expert  system  functions. 
Alternative  frame-works  differ  in  the  concept  of  uncertainty  they  attempt  to 
capture  (t.g.,  chance,  imprecision,  or  incompl  b  tens  a  s  of  evidence)  and  the 
degree  to  which  appropriate  normative  justifications  have  been  achieved. 

They  differ  also  in  the  demands:  they  impose  on  experts  for  as sesaments,  in  the 
conputetiarijil  burden  they  Impose  ott  the  system,  and  in  the  esse  with  which 
they  represent  distinctions  and  yield  conclusions  which  ate  natural  to  a  par¬ 
ticular  expert,  user,  or  problem  domain,  Design  choices,  in  short,  must  he 
multidimensional.  But  It  is  by  tlo  means  clear  how  tradeoffs  among  these  com¬ 
peting  considerations  should  be  resolved. 

Perhaps  more  importantly ,  Current  expert  systems  have  typically  incorporated 
rather  prloit-ive  knowledge  representation,  schemes  (e.g, ,  a  homogeneous  collec¬ 
tion  of  rules),  and  such  systems  have  been  unable  to  duplicate  the  adapt  Ivan 
iterative  model  revision  process  practiced  by  huaan  experts. 

The  present  work  represents  an  initial  effort  to  address  these  technical  chal¬ 
lenges  in  the  context  of  avionics  expert  systems .  The  ultimate  objectives  are 
to  develop  improved  Inference  arch.ltectu.ree  for  pilot  decision  aid  applica¬ 
tions  and  to  develop  a  more  general  understanding  of  the  process  of  choosing 
and  designing  inference  frameworks  for  avionics  expert  system  applications. 
Existing  approach**  tv  reasoning  shout  uncertainty  heve  been  critically 
analyzed  and  an  innovative  inference  framework  has  been  developed  which  incor¬ 
porate  s  elements  o£  a  Variety  o£  existing  approaches  And  which  provides  a 
unique  capability  for  adaptive  self- improving  inference.  The  feasibility  of 
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this  concept  h49  been  demon* C  raced  in  a  specific  oviotiie*  application  ft  re  a: 
i.s.j  inflight  r^utc  re  ■■  p  banning  in  the  face  of  Strategic  pop-up  threat*.  A 
prototype  Sid  hifi  been  developed  for  demonstration  purpose*  which  Illustrate* 
both  the  Inference  framnvntk  and  the  uscr/computer  interface,  and  which  will 
serva  as  a  foundation  for  continued  research  and  development. 


1 . 3  a^jpmaxs.  p£  Specific  Objectless  fiUhs_^afie^Xsb 


In  sum,  the  specific  objectives  of  the  present  research  (described  in  detail 
in  the  following  sections}  ware 5 


o  to  perform  a  critical  review  and  evaluation  of  alternative  inference 

framework a  {including  Bayesian ,  Shaferian,  fuzzy „  non- mono tonic } „  iden¬ 
tifying  strengths  and  weaknesses  for  use  in  expert  systems  designed  for 
real-time  tactical  environments  (Section  2); 

o  Co  develop  improved  inference  frameworks  for  real-time  tactical  expert 
systems  (Section  3} : 

0  to  develop  concepts  for  huiian -computer  interaction  (Section  5); 

o  to  implement  the  developments  of  Phase  1  in  a  small-scale  prototype  sys- 

ten  Itl  a  selected  avionics  context  (SectionE  4  and  5>, 


The  overriding  dift  Of  the  present  research  effort  was  to  demonstrate  the 
feasibility  of  our  inference  framework.  From  the  results  reported  below  it  is 
oleer  that  this  objective  has  been  met.  Section  6  disco sees  directions  £ot 
future  research,  both  theoretical  and  applied. 
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2.0  fcEVJEU  AND  CULTURE  OF  ALTEUMTE  INFEkF-tfCE  FfcAWEUCftKS 


2.1  Overview. 

FCV  puipciSLi  of  this-  nviev,  we  divide:  inference  theories  into  three  general 
categories  ,  The  first  category  is  that  of  quantitative  theories  for  repre¬ 
senting  and  man i pula  ting  uncertainty.  Of  these,  Bayesian  probability  theory 
(e.g.j.  Savage ,  1954)  has  the  longest  and  most  distinguished  history. 

Recently,  a  great  deal  of  attention  has  been  devoted  to  two  newer  numerical 
theories;  Shafer's  (197{i)  theory  of  belief  functions  and  Zadeh's  (1965) 
theory  of  fujzy  logic. 

The  second  category  of  inference  theories  is  a  aet  of  qualitative,  non - numer fa 
inference  frameworks.  Our  discussion  begins  with  a  brief  mention  of  classical 
logic.  Based  on  classical  logic  ia  the  theory  of  non - mono ton ie  logic  (Doyle 
19? 9)  ,  which  is  an  outgrowth  of  theorem ‘proving,  systems  in  artificial 
intelligent*.  Non -niono tonic  logit  allows  for  provisional  acceptance  of  uncer¬ 
tain  premises,  which  may  later  be  retracted  when  they  lead  to  contradictory 
conclusions.  Toulmin  £1958}  introduces  a  new  theory  of  legit  based  on  an 
analogy  with  jurisprudence  rather  than  the  abs. tract  mathematics  o£  classical 
logic.  Paul  Cehcn1 £  (1965)  theory  of  endorsements  is  another  outgrowth  of  the 
artificial  intelligence  tradition.  Cohen's  eye tea  represent*  uncertainty 
about  a  rule  or  conclusion  by  qualitative  ejicforsemen tf  „  which  are  propagated 
through  inferences  to  conclusions . 

The  third  category  of  Inference  machanlsus  consists  of  systems  attempting  to 
synthesize  logic  and  probability  in  some  way.  Two  approaches  ate  discussed; 
Lagomasino  and  Sage  (1985)  ostensibly  base  their  theory  on  Toulmin1  *  theory  of 
logic,  while  Nilsson  (1964)  uses  classical  logic. 

2,2  Numerical  inference  theories, 

2.3,1  Bayesian  probabilistic  inference.  E/sInjj  probability  theory  far  ln«MCt 
reasoning-  Probability  theory  has  become  central  to  modern  a ci anti fie 
culture .  As  such,  it  is  the  obvious  calculus  to  consider  for  handling 
actness  in,  expert  systems.  Its  supporters  in  this  vole  data  back  to  th*  early 
work  on  probabilistic  information  processing  (see  Edwards,  1966)  snd  curlier; 
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more  recent  contributors  have  been  do  (Domhal.  (1973),,  In  the  field  o£  medical 
decision  asking,  end  Sebum  (19 00)  in  Che  Intel ligence  field. 

The  applies  cion  of  probabilistic  re n^nning  to  rule -based  expert  ay  sterna  is 
complex*  but  it  tan  be  illustrated  with  a  Simple  example.  Fart  of  an  expert 
system  for  avionics  applications  COuld  be  a  threat  classification  system.  A 
rule  in  such  a  system  might  be; 


IF  (OBSERVED  SIGNAL  ItAS  FEATURE  30 
THEN  (THREAT  IS  BA-4)  tR  -  2.3) 

where  LR  quantifies  the  impact  o£  the  evidence  (the  signal  feature)  cm  the 
hypothesis  (that  the  threat  is  an  Si-4) .  LR  is  a  likelihood  ratio,  i.e.t  the 
probability  df  a  Signal  with  feature  Of  type  X  given  that  the  threat  Is  an  SA- 
A  divided  by  the  probability  of  that  signaL  feature  given  that  It  is  not  an 
BA- 4.  Satisfaction  of  the  antecedent  of  this  rule  would  lead  to  a  process  of 
Bay* tied  updating,  in  which  the  Impact  of  the  deV  evidence  is  combined  with 
the  prior  odds  of  the  hypothesis  btlng  true.  Suppose  H.  is  the  hypothesis  that- 
the  object  is  an  SA-4,  Then  EaytS-1  Theorem  gives,  in  odds -likelihood  form, 

EeIMUU  *  Pr TD^H]  Frtttl 

Pf[E|61  Pr [ D | H 1  ‘  frfK] 

where  D  is  the  data  that  th*  signal  has  feature  k,  and  H  is  the  hypothesis 
that  some  other  clarification  of  tin;  threat  is  appropriate,  To  cerry  out  a 
*  tipple  analysts  oE  this  kind,  throe  as  s  esstnen  t$  aro  requited,  namely  FrfDlH] , 
Fr[D|iTl  and  Pr[H]  ,  i.e,,  the  likelihoods  and  the  prior  probability. 

Work  on  ftayesian  approaches  to  Inference  has  advanced  from  *  simple  Onc-sfep 
application  of  Bayes1  rule  to  the  elaboration  in  recant  research  of  rather 
complex  structure %  capable  of  capturing  a  wide  diversity  of  human  inf or onto 
tasks  and  prescriptive  intuitions  <e.g.t  Echum,  1979 ,  1961),  Bayesian 
techniques,  for  exsraple,  are  able  to  accommodate  a  number  of  different  ways 
that  Items  of  evidence  can  be  related  to  one  -another  with  respect  Co  a 
hypothesis  (Sebum  and  Martin,  1960)l  e.g.,  they  may  be  contradictory 

(reporting  and  denying  the  same  event)  ,  corroboratively  redundant  (reporting 
the  same  event) ,  cumulatively  redundant  (reporting  different  events  which 
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reduce  cue  another's  evidential  Impact),  or  non -redundant  (reporting  different 
events  which  enhance  or  do  not  change  one  another's  evidential  impact).  In 
other,  more  complex  cases  o£  interdependence T  Bayesian  techniques  capture  the 
evidential  impact  of  biases  In  an  Information  source  or  non *  independent e  of 
information  source  sensitivity  with  respect  to  what  is  being  observed. 

Tile  following  discussion  highlights  the  major  strengths  and  weaknesses  of  the 
Bayesian  approach  to  uncertain  reasoning  in  expert  lyittni, 

f’frpsj&ff ity:  Quantity  of  inputs.  When  OiW  attests  td  U**  Rayesiao  probabil¬ 

ity  theory  on  real  inference  problems,  one  quickly  becomes  aware  of  the  com¬ 
plexity  of  the  task.  This  complexity  led  Sftortliffe  {apparently)  to  -construct 
his  calculus  of  certainty  factors  as  an  alternative  {see  ShortLiffe,  1976, 
Section  3.2).  Sebum  (IP EC,  p.  207)  ends  his  advocacy  of  the  Bayesian  approach 
with  a  negative  note:  V,  .now  we  hsve  other  problems,  I  believe  nobody  real¬ 
ized  how  many  ingredients  there  would  be  and.  how  complex  the  judgments  about 
these  ingredienta  would  be  even  in  apparently  simple  cases,"  Tn  all  but  the 
most  trivial  cases,  a  proper  Bayesian  analysis  requires  a  great  many  condi¬ 
tional  probabilities  to  bs  assessed,  Sebum  presents  the  analysis  of  a  fairly 
simple  legal  trial  involving  7  pieces  of  evidence  (Salmon' s  pills)  and  shows 
that  at  least  27  probability  judgments  are  needed,  even  if  all  reasonable  in¬ 
dependence  conditions  hold,  As  well  as  requiring  a  very  large  number  of  prob¬ 
ability  assessments,  the  relations  between  them  are  difficult  to  organize,  and 
the  coherence  of  the  total  set  of  assessments;  is  often  difficult  to  detarnine. 

Two  important  lines  of  defense  for  Bayealaus  are  {a)  chat  simplifying  Assump¬ 
tion*  tan  always  be  made,  e.g.,  equal  prior  probabll i t le s ,  conditional  inde¬ 
pendence  of  events and  {b)  that  variable*;  which  utio  does  not  cape  to  deal 
with  may  he  "integrated  out,"  i,&,3  the  resulting  probabilities  are  regarded 
as  marginal  ( "average* ")  with  respect  to  possible  value*  of  the  ignored 
variables .  Thus,  0  Bay**ian  ™odeI  «my  be  crofted  which  £  s  Os  s Iwpl c  AS  one 
liko;: . 

Unfortunately,  however,  the  situation  is  not  quite  as  cleat  cut  as  this. 
"Simplifying  assumptions"  must  in  some  sense  be  judgments  {e„g, ,  that  priors 
ate  roughly  equal,  that  events  are  conditionally  independent).  Otherwise ,  one 
sacrifices  the  validity  of  the  Bayesian  approach.  As  one  Bayesian  (Lindley, 


19B4)  haa  put  it,  the  Bayesian  argument  shows  you  Eh*  things  you  have  to  think 
about;  io,  think  about  them.  Front  the  Bayesian  point  of  view,  an  argument 
which  omita  these  factors  is  simply  spurious*  In  the  ease  of  *  tote  gr*t  lug 
oaL"  certain  variable a,  no  formal  probleu  presents  Itself,  since  from  a 
theoretical  point  of  view  the  results  with  end  without  such  variables  should 
be  the  same,,  In  actual  fact,  however,  the  difference  in  plausibility  of  the 
overall  analysis  can  be  very  great  (aa  ve  shell  cote,  below).  Thus,  although 
the  required  number  of  assessments  may  in  fact  he  reduced  by  el Cher  of  these 
means,  the  difficulty  of  the  judgments  required  to  da  so  way  be  considerable* 
Sehine  speaks  of  them  as  "exqui  3  Ltely  subtle". 

A  quite  different  approach ,  which  »»  shall  expiate  in  greater  detail  below,  1* 
to  regard  simplify 3 eg  ^tfacpgles  ns  assumptions  whose  validity  is  tested  im¬ 
plicitly  through  their  uso  in  reasoning.  If  the  outcome  of  using  such  assump¬ 
tions  is  plausible,  the  burden,  of  explicitly  judging  their  validity  it 
avoided* 

A  related  tactic  la  to  accept  the  Bayesian  framework  u,  to  principle,  the 
correct  way  to  handle  uncertainty,  artd  divert  our  research  interest.*  to  ap¬ 
proximations  that  are  as  close  as  possible  to  the  Bayesian  norm,  Indeed^ 
Shortliffe  (1976,  p,  1-64)  originally  saw  certainty  factors  as  a  device  in  chi* 
direction*  Shortliffe,  however,  did  not  explicitly  derive  hia  theory  as  a 
Special  case  of  the  more  general  bayeslan  nodal.  Adams  (1976)  showed  that  as¬ 
sumptions  necessary  to  derive  Shortliffe' a  postulates  in  some  ca*es  do  nut 
♦list,  and  in  Other  cases  are  far  mom  restrictive  and  implausible  than  the 
usual  assunptions  of  equal  priors  and  conditional  independence.  We  shall 
return  to  this  topic  in  the  disease ion  of  Shafer's  theory  (Section  2.2,2). 

CoEymtationeri  tt&ctabl llty.  There  is  no  known*  computationally  tractable 
method  for  propagating  uncertainties  cone latently  through  an  arbitrary 
Bayesian  network*  Restrictions  of  some  sort  on  the  kind  of  model  that  is 
utilised  are  necessary.  The  only  question  (as  in  the  previous  discussion  of 
inputs)  is  whether  the  restrictions  will  he  plausible  define  a 

meaningful,  useful  special  case  of  Bayesian  modeling)  or  ed  fioc,  PROSPECTOR 
adopted  the  latter  approach.  Mora  recently,  Pnatl  (1993)  and  t£L*  (1983)  have 
explored  th*  former,  They  show  that  independence  ssSuiKpCiotiE  walfit  ScrtSC,  and 
probabilities  can  be  propagated  by  simple  Local  computations,  if  ch*  infer™- 
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tial  network  has  (a)  a  causal  interpretation,  and  (b)  the  form  of  a  Chow  tree 
£l.e,,  ft  lacks  undirected  cycles},  Unfortunately,  not  all  real  problems  will 
fft  this  spec lul  structure. 

If  validity  is  not  to  be  sacrificed,  computational,  testability  for  a  JBayestan 
system  can  be  purchased  only  in  special  cases;  and  even  then,  only  at  the  cost 
of  complex  and  subtle  Judgements  regarding  interdependence  among  items  of 
knowledge  and  the  overall  structure  of  the  inferential  argument.  As  ve  shall 
see,  the  situation,  is  quite  similar  for  Shafer ian  belief  functions.  For  this 
reason,  Shafer  £1964 a)  ha  a  recently  argued,  the  introduction  of  probability 
into  expert  systems  appears  to  be  inconsistent  with  the  modularity  of 
knowledge  representations  that  up  to  now  has  been  the  tost  salient  charac¬ 
teristic  of  such  systems . 

In  Section  5  we  eha-ll  return  to  some  of  these  questions,  Ve  will  propose  that 
a  careful  ilic  of  quel festive  reasoning,  superimposed  upon  a  probabilistic 
system,  may  reduce  the  requirement  for  experts  {or  users}  to  address  issues  of 
interdependence  and  to del  structure  explicitly,  and  make  such  assessments 
easier  when  they  are  required,  without  undo  compromise  of  validity.  In  Sec¬ 
tion  4,  we  describe  a  small-scale  pilot  implementation  of  sn  avionics  expert 
system  based  on  this  approach, 

Validity.'  Axfojjjatit  derivation,  Bayes  tan  probability  theory  has  a 
preeminent h  though  perhaps  not  conclusive,  claim  to  validity  among  current 
proposals  for  the  handling  Of  uncertainty,  De  Finetti  £1937/1964)  Showed  that 
unless  your  beliefs  Conform  to  the  rules  of  probability,  a  clever  opponent 
could  make  you  the  victim  of  a  “Ihifcch  book,"  i,e,,  a  set  of  gambles  you  would 
accept,  but  in  which  you  lose  regardless  of  the  outcome  of  an  uncertain  state 
of  affairs.  More  recently  „  Lindley  (1962)  has  given  a  new  derivation.,  Sup¬ 
pose  that  people  are  going  to  measure  the  uncertainty  of  events  by  some 
method,,  and  we  wish  Co  know  how  good  they  are  at  doing  so.  If  we  devise  a 
scoring  system  of  any  sort- -as  along  as  (a)  the  score  is  a  joint  function  of 
the  uncertainty  measure  and  the  event’s  truth  or  falsity,  and  (b)  scores  are 
additive  across  different  events --then  no  matter  what  events  actually  occur, 
the  best  achievable  start  will  always  go  to  a  form  of  Gaye-Sisn  probability, 
Lindley  concludes  that  "only  probability  is  *  senitbl*  description  of 
uncertainty. * 
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A  common  objection  to  this  sort  of  demonstration  ii  that  v*  arc  rtOt  In  fact 
always  (or  naval ly)  faced  with  a  malicious  adversary  orh  indeed,  with  a  ieer^ 
Ihe  eye tern .  But  the  point  is  not  that  We  are*  or  should  somehow  presume  that 
we  are.  always  subjected  to  such  peculiar  circumstances.  Even  if  va  never  on* 
counter  these  conditions,  other  things  being  equal,  a  system  which  has  the 
property  -of  working  well  In  them,  is  more  desirable  (in  all  circumstances)  than 
one  which  does  not.  It  Is  plausible  than  an  adequate  system  of  uncertainty 
would  guard  against  s  butch  book.  It  la  plausible  that  such  a  system  would 
score  high  if  we  ever  chose  to  score  it. 

The  mare  fundamental  objection,  In  our  view,  Is  that  while  probability  theory 
has  been  shown  uniquely  to  possess  a  desirable  property,  but  has  not  bean 
shown  to  be  uniquely  Justified,  Other  systems  of  uncertainty  may  have 
desirable  properties  that  probability  theory  lacks.  (In  particular ,  alterna¬ 
tive  theories  i*ighc  deaL  note  adequately  with  different  kinds  of  uncertainty, 
Such  4i  S Tit o*rpl c Lone s s  of  evidence  nr  Imprecision.  In  this  regard,  note  that 
be  Fi&attt1*  And  Lltidley's  arguments  do  hot  apply  to  systems  which  provide 
mot*  than  A  single  measure  of  uncertainty  for  each  event,  such  as  the  upper 
and  lower  measures  In  Shafer's  theory,  or  fuzzy  probabilities  In  Zadeh's.) 

Nonetheless,  It  seems  Incontrovertible  to  oe  that  the  existence  of  founda¬ 
tional  arguments  such  as  those  described  Is  a  strong  plus  for  Bayesian  theory. 

Plausibility  of  instances.  The  thrust  of  Bayesian  analysis  is  to  improve, 
rather  than  to  replicate  ordinary  thinking,  Bayesi-aus  argue  that  if  one's  or¬ 
dinary  intuitions  are  probabilistically  incoherent,  they  ought,  to  be  changed. 
We  might  expect,  nevertheless,  that  these  revisions  of  belief  would  typically 
lead  to  judgment e  that  ara  regarded  as  more  plausible  after  reflection.  In 
other  words,  the  plausibility  of  the  axioms  should  outweigh  the  initial 
plausibility  of  an  incoherent  sat  of  judgments.  In  seme  caaen,  this  seems 
true,  e,gr,  most  people  who  understand  an  explanation  of  the  “'gambler's 
Fallacy  *  seen  to  accept  that  it  1$  a  fallacy’  in  other  eitn,  perhaps ,  it  is 
not  true  (c,g,,  Blovi-c  and  Tver  sky,  1974), 

There  is  another  issue  here  which  is,  we  feel,  more  important.  Even  if 
revised  (hence,  coherent)  beliefs  are  more  plausible  than  unrevised,,  in¬ 
coherent  ones,  all  the  credit  cannot  go  to  bays slap  theory.  The  reason  is, 


I 
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that  the  a elect! cm  of  e  specific  revision  is  net  uniquely  Cetentined  by  the 
requirement  of  coherence.  Consider,  again,  the  example  above  of  Inferring  the 
chance  of  H,  l.t.,  that  a  particular  threat  Is  an  SA-4,  based  on  analysis  of  a 
signal  A.  Bayesian  theory  tell?;  us  only  that  cur  assessment  of  Pr[H]  should 
be  the  same  as  Pr[H|A)FrlA]  +  Ft  [51  [  A J  Fr  | A]  ,  which  is  based  on  our  assessments 
of  Fr[HlAJ,  Pr[A] ,  and  FrflllA|*  The  theory  provides  no  guidance  in  the  case 
where  the  two  ate  not  equal.  Coherence  by  itself  does  not  dictate  that  the 
result  of  an  analysis  Is  to  be  preferred  to  a  direct  judgment.  We  might 
choose  to  revise  one  or  more  of  the  assessments  in  the  analysis,  rather  than 
to  revise  Pr  [H] . 

This  problem,  which  we  may  call  the  Incompleteness  of  Aayeaian  theory,  is  ex¬ 
acerbated  by  the  fact  that  in  any  problem  there  is  more  than  one  passible  form 
of  analysis.  Many  advocates  and  many  critics  of  the  Bayesian  approach  seem  to 
t&ply  that  thtre  is  *nly  on*  Way  e  probabilistic  analysis  could  be  carried  out 
and  only  one  possible  conclusion.  To  sec  that  this  is  not  the  Case,  we  return 
to  the  example  of  inferring  B,  Let  £  b*  Intelligent*  information  that  ths 
country  in  question  had  purchased  in  the  last  year  an  important  component 
required  for  construction  of  an  £A-A  Installation.  Instead  of,  or  in  addition 
to,  conditioning  our  assessment  on  A,  as  »bove3  we  could  condition  on  B, 
namely 


Fr[H]  -  ET[H\B]Pr[Bl  +  fr [H| BJ Pr [ ft] . 

Yet  again,  me  could  condition  Jointly  on  A  and  E: 

Pr[HJ  -  Pr£H|A£]Pr[A£]  +■  Fi[H|AS]Pr[A£l  +  Pr[H|AB]Fr[ AE]  +  Pr [H|Ab] Fr |AB| . 

Still  <BOtfc  tboicae  are  open  to  u*:  Cor  example,  V*  could  assess  Pr[ABj 
directly,  and/or  further  analyst*  it  as  Pr(A|B]Fr  [B] ,  and/or  as  Fr{B |  AjFr  [ A] . 

The  Bayesian  theoretical  attitude  Is  straightforward,  namely  that  it  does  not 
matter  which  of  these  forms  of  analysts  wo  perform  or  which  answer  w*  select,, 
since  coherent  probability  assessors  should  derive  the  same  number  whichever 
method  they  choose.  Theory,  however,  ia  of  us^.  because  we  are  not  ordinarily 
coherent  in  our  assessments.  An  analysis  may  well  give  us  a  different  a a- 
Mmate  of  Pr[Hl  than  if  -we  directly  Judged  it;  otherwise,  we  wouldn't  bother 
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with  the  analysis.  Moreover,  different  analyses  may  well  give  us  different 
answers;  otherwise,  we  would  have  no  cause  for  regarding,  some  analyses  as 
"better"  than  others. 

An  important  assumption  of  Bayesian  theory  is  that  all  analyses  (by  the  same 
person)  are  based  on  the  same  evidence;  they  do  not  differ  in  the  knowledge 
they  draw  upon.  We  would  argue  that  this  is,  psychologically,  not  true .  Dif¬ 
ferent  ways  of  formulating  the  sane  problem  may  well  tap  different  internal 
stores  of  information.  What  is  missing  from  the  Bayesian  framework  is  some 
notion  o£  the  quality  of  probability  inputs,  i.e.,  the  amount  of  knowledge  or 
completeness  of  evidence  that  underlies  them.  Several  points  can  he  made: 


a  Revision  of  probability  judgments  should  he  guided  by  a  Judgment 
of  their  quality,  i.e.,  the  amount  of  knowledge  they  represent, 

•  Home  than  one  analysis  may  be  of  value,  if  they  bring  different 
knowledge  to  beer  on  a  problem  (of.,  Brown  and  Lindley,  19B2, 
19&S)t 

*  The  application  of  Bayesian  theory  to  a  problem  is  not  necessarily 
a  linear  process  in  which  inputs  are  provided  end  conclusions 
computed.  It  is  (or  often,  should  be)  an  iterative  process.  In 
which  comparison  of  conclusions  arrived  at  by  different  method* 
leads  to  revision*  of  inputs  and  assumptions,  until  overall  con¬ 
sistency  is  achieved. 


In  ordinary  statistical  problem  solving,  perhaps,  judgments  of  quality  o&ay 
safely  remain  implicit.  But  a  major  limitation  in  the  automation  of  Bayeaian 
theory  within  expert  system*  is  the  lack  of  an  explicit  measure  of  complete¬ 
ness  of  evidence,  and  a  mechanism  for  its  use  in  the  revision  of  probability 
estimates . 


This  will  bo  a  major  focus  in  our  di ecus a ion  of  Shafer,  below,  and  in  the  new 
developments  to  be  described  in  Section  3-. 

Semantics:  Behavioral  specification ,  Bayeaian  theory  provides  a  clear  be¬ 
havioral  interpretation  of  probabilities  ip  terms  of  preferences  among  bets. 

We  can  know  what  someone's  probabilistic  beliefs  are  by  observing  their  ac¬ 
tions  under  specified  conditions.  By  contrast,  a  common  complaint  by 
Bayesians  regarding  other  theories  is  the  difficulty  of  knowing  what  the  basic 
measures  mean. 
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Thera  are  three  different,  but  related,  mi  sunder standing  of  this  H operational 
definition.'*  First .  cr i tics  point  out  that  betting  may  be  an  awkward  and  in 
some  oases  an  impossible  method  for  eliciting  probabilities.  It  £b  often 
easier  to  ask  for  direct  verbal  judgments.  There  is  a  standard  answer  to  this 
point  by  sophisticated  BayesiansL  Meaning  need  not  be  equated  with  evidence. 
Bayes ions  can  use  any  method  they  like  for  estimating  your  probabilitie  s,  if 
there  is  a  reasonable  expectation  that  the  result  will  natch,  or  at  least 
approximate,  what  they  would  have  gotten  had  they  used  the  betting  paradigm. 

This  response  hides  a  tore  subtle  [tieunderstanding.  It  is  still  assumed  that 
we  can,  at  least  in  principle,  always  know  what  a  person's  probabilities  ate. 
simply  by  testing  his  preferences  among  bets.  Since  the  operational  defini¬ 
tion  specifies  a  Situation  where  he  must  make  a  choice,  It  is  implied  that  any 
person  "has"  probabilities  waiting  to  be  uncovered  or  "elicited” ,  Is 
&*yesiantKB  thus  inevitable?  This  conception  *ee«s  to  be  contradicted  by  the 
Intobe pence  we  typically  find  in  people's  unaided  Judgments,  and  which  is 
&mpLy  documented  in  the  experimental  psychology  literature  Kiihmcmcm. 

Slcvie,  and  Tversky.  1982), 

The  sophisticated  Bayesian  was  right,  wo  suggest.  In  distinguishing  moaning 
and  evidence.  But-  -sophisticated  aa  he  i*--he  has  nut  absarhed  the  full  in' 
plications  of  that  distinction,  Although  he  permit*  other  kind*  of  evidence, 
he  is  still  equating  meaning,  with  a  particular  observable  operation.  The 
problem,  a*  pointed  out  by  Quine  £1953)  and  other*  In  a  mote  general  critique 
of  positivism,  ia  Char  the  selection  of  this  rather  than  *ome  other  component 
of  the  theory  as  a.  "definition**  is  arbitrary.  To  return  to  our  aarJier 
example,  suppose  ve  equate  Pr[ti]  for  a  person  X  with  X1  s  betting  behavior  in 
regard  to  k.  Then  we  determine  in  the  same  way  his  value  for  PrfH|AI, 

Pr[H|A],  and  Pr[A],  Finally,  we  compute  a  new  probability  of  d,  frfIH|,  from 
the  latter  three  values.  Uhy  shouldn't  ve  define  It's  probability  for  H  in 
terns  of  this  operation,  l,e.*  as  Pr-[H]?  One  reply  is  that  this  operation 
requires  a  theoretical  assumption  viz, ,  that  It  Is  coherent,  to  Justify  the 
computation  of  Pt1  [H]j  froa  Fr[H|A]  ,  FvIHI  A,].  and  Pr^A]  ,  But  the  earlier 
^operational  definition”  could  be  regarded  as  theoretical,  toQ.  since  it  is  a 
theoretical  hypothesis  (i.e,T  that  X  acts  so  a*  to  maximlEa  subjectively  ex¬ 
pected  utility)  that  enables  us  to  derive  X'#  probability  for  k  from  his 
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preferences  among,  gambles  involving  K .  Conve raely ,  vs  collI d  regard  the 
definition  In.  terms  of  Pr'fB]  as  purely  "behavioral" ,  by  ignoring  the 
thee  ire  tl  cal  hypotheses  Id  pile  it  in  otir  calcuUtipni, 

It  is  far  more  natural  to  regard  all  these  potential,  "definition*"  *  Imply  a* 
theoretical  predictions,.  How  then,  without  definitions;,  dn  we  a±ac«s  the 
probaht littes  and  utilities  required  e*  derive  the  predict lena?  the  answer  is 
that  tasting  a  theory  Is,  inevitably,  a  bootstrapping  operation.,  in  which  we 
use  the  theory,  as  if  it  were  true,  to  estimate  values  for  an  interrelated  set 
of  parameters,  then  test  for  consistency  of  the  results.  If  the  results  are 
consistent,  the  theory  Is  confirmed-  If  not.  It  is  diseon firmed.  (for  a 
general  discussion  see  Gly<»oren  1980  r)  To  the  extent  that  people  are  prob¬ 
abilistically  incoherent 3  therefore,  probability  cheery  Is  dJ-seortflnued ,  and 
they  cannot  be  regarded  as  "having"  probabilities  at  all. 

Have  we  overlooked  the  difference  between  descriptive  and  prescriptive 
theorlea?  Perhaps  "operational  definitions"  ~ake  sense  for  probabilities  be¬ 
cause  they  form  part  of  a  prescriptive  theory.  On  the  contrary,  we  suggest 
that  there  is  a  strong  and  important  parallel  between  theory  testing,  ae  we 
just  described  it,  and  prescriptive  analysis.  Just  as  in  descriptive  science, 
we  assume  the  prescriptive  theory  to  be  true,  use  it  to  perform  a  set  of  in¬ 
terrelated  analyses,  and  then  test  them  for  consistency .  However,  if  we  find 
inconsistency  among  alternative  prescriptive  analyses,  or  between  an  ana ly a it 
and  direct  Judgment,  we  do  not  (necessarily)  drop  the  prescriptive  theory;  Wo 
may  chocs t  tc  revise  the  value*  in  one  nr  more  analyses  so  as  to  them 

cons  is  tent.  In  po  doing,  wo  cons  cruet  rather  than  discover  or  confirm  s  prob¬ 
ability  model  for  Out  beliefs, 

"Jhat  then  is  loft  of  the  Bayesian  claim  that  operational  definitions  are 
required  for  clarity  of  concepts?  The  third  and  final  ntsunde ra tanding  we 
wish  CO  Address  tfl  the  notion  that  because  "operational  definitions"  are 
arbitrary,  »ftd  do  not  guarantee  the  applicability  or  even  the  relevance  of  a 
prescriptive  theory,  that  behaviors  i  spec  f  float  ion  Is  of  no  use.  In  fact,  it 
is  quite  critical:  without  it,  there  is  no  link,  of  els*  no  clear  link,  be¬ 
tween  the  prescriptive  theory  and  action.  With  it,  the  prescriptive  process 
described  above,  in  which  a  coherent  set  of  judgments  is  arrived  at  through 
successive  iterations,  also  produces  a  clear  set  of  implications  for  action.. 
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In  expert  system  applications,  such  Jmpl  1  cations  ate  typically  the  reason  for 
developing  the  system,  Moreover,  SMth  specif feat lens  may  play  a  clarifying 
role  for  Cue  decision  maker  in.  cht  process  of  iteratively  arriving  at  an  ap¬ 
propriate  set  of  judgments ,  The  existence  of  such  specifications  must, 
therefore,  be  counted  as  a  plus  for  the  tayc* Ian  theory, 

Naturalness  of  inputs,  Behavioral  specification  la  not  sufficient  to 
guarantee  the  usefulness  of  an  inference  framework.  A  common  objection  to 
Etayealan  theory  urged  by  proponents  of  alternative  views ,  is  that  the  inputs 
It  requires  exceed,  in  various  ways,  the  capabilities  of  the  decision  makers 
it  is  designed  to  aid.  A.  distinction  must  be  made  between  two  types  of  claim 
against  Bayesian  theory:  that  it  falls  adequately  to  deal  with  imprecision 
and  with  incejupletortess  of  evidence . 

Bayes Ians  assume  that  experts  are  capable  of  quantifying  their  uncertainties 
and  values  to  an  arbitrary  degree  of  precision.  But  this  is  true  of  no  other 
known  process  of  measurement.  Experts  nay  simply  not  know,  to  the  required 
exactitude,  what  their  beliefs  or  preferences  are. 

Alternate Ly,  the  evidence  may  bo  incomplete  in  that  it  does  not  justify  the 
degree  of  confidence  suggested  by  use  of  a  single  number  to  oases s  an 
uncertainty,  Some  assessments  (■?,£,,  the  probability  that  the  Soviets  will 
inviidc  UnutEFfl  Europe  wicMn  the  next  year)  ere  less  well  supported  than 
others  (e-g„ ,  the  probability  that  a  coin  in  my  pocket  will  land  head*  i£ 
tossed),  In  the  former  cases,  eh*  available  evidence  way  Justify  no  more  than 
a  range  of  probabilities  tether  than  a  single  number. 

Theto  is  an  Important  distinction  between  those  two  complaints:  the  first  is 
cons la tent  with  the  basic  prescriptive  adequacy  of  probability  theory,  but 
seeks  to  accommodate  buiL-an  shortcomings  in  the  assessment  task.  In  contrast, 
the  second  objection  has  a  normative  basis:  probabilities  themselves  are  in¬ 
appropriate  where  evidence  is  incomplete,  He  shall  explore  these  positions  in 
more  detail  in  our  discussions  of  Zadeh  snd  Shafer,  respectively. 

A  related  problem  la  that  the  Bayesian  framework  addresses  probabilistic  and 
pot  causal  relaricitshlps ,  In  many  instances  (particularly  for  applications 
for  which  rult-bastd  (LXpcrt  systems  are  suited)  people's  reasoning  processes 
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are  naturally  causally  oriented  (Abels on,  19£5;  Rees,  1977;  Tversky  and 
Jiahf.aman ,  1 9 B 2 )  .  People  zav  interpret  probabilistic  Information  causally  , 
leading  to  commonly  observed  biases  such  as  ignoring  base  rates  or  the  con' 
Junction  fallacy.  The  persistence  of  such  biases  (Tver sky  and  Kahneman,  llfll) 
points  to  the  difficulty  of  translating,  causal  reasoning  into  probabilistic 
j  ud  Lj  ts  . 

Concepts  of  uncertainty,  Bayesian  theory  fa  clearly  designed  CO  capture  the 
concept  of  chance,  or  uncertainty  about  facta.  We  argued:  that  *n  important 
gap  In  Bayesian  theory  is  the  lack  of  a  maaeura  of  completeness  or  quality  of 
evidence,  tre,,  the  ]aok  of  a  distinction  between  firm  probabilities;  (.5  ea 
the  probability  of  heads  on  a  coin  toss)  end  those  based  on  guesswork  (,S  as 
the  probability  of  a  Soviet  invasion) .  Intuitively,  the  weight  of  evidence 
supporting  sore  probability  judgments  is  stronger  th&t  that  supporting  others, 
We  argued  that  this  concept  in  fact  plays  an  important  role  in  ordinary  ap¬ 
plications  of  probability  theory,  by  guiding  the  choice  among  potential  revi¬ 
sions  of  belief  in  the  light  of  an  analysis  or  set  of  analyses,  tie  hope  to 
demonstrate  below  (Section  3)  that  an  explicit  measure  of  this  sort  is  criti¬ 
cal  for  the  control  of  reasoning  in  an  expert  system  that  intelligently 
handles  uncertainty  about  facts. 

To  what  extent  could  Bayesian  theory  itself  he  extended  to  cover  the  concept 
of  completeness  of  evidence?  Lindley  et  al .  (1979}  have  recently  attempted  te> 
formalize  the  intuitive  notion  that  we  are  firmer  about  some  probability 
assessments  than  others.  The  tool  they  introduce  is  a  second -order  probabil¬ 
ity  distribution  over  possible  values  of  the  tiue  first-order  probability, 

The  spread  of  the  second- order  distribution  is  a  measure  of  the  firmness  of 
the  original  probabilities,  Lindley  et  al .  have  described  procedures  for 
statistically  aggregating  Inconsistent  probabilistic  analyses  by  means  0-f  such 
sec  ond  -  or  do  r  j  udg^nents  „ 

These  effort*  have  failed,  in  Our  opinion,  for  a  variety  of  reasons. 
Feasibility:  The  quantity  and  difficulty  of  required  inputs  is  increased,, 
rather  than  decreased,  to  the  degree  that  one's  evidence  is  incomplete.  Com¬ 
putational  intractability  will  certainly  he  increased  as  well.  Validity; 
Axiomatic  justlf Ications  and  behavioral  specifications  which  apply  to  first- 
order  probabilities  b econo  much  less  convincing  at  higjher  Uvd £ ,  whurt,  for 
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example,  gambles  or  scores  which  depend  on  one's  ovn  "true"  probabilities., 
rather  than  actual  events ,  lack  plausibility,  Pace  validity  la  dubious  as 
well ,  e.g.,  if  we  attempt  to  measure  the  quality  of  out  second-order  prob¬ 
abilities  tfl  the  same  way,  wa  are  threatened  with  an  Infinite  regress,  Per¬ 
haps  the  most  serious  difficulty,  however,  la  the  implauslbllity  of  the  In¬ 
ferences  to  which  this  model  gives  rise.  In  brief,  the  procedure  for  eg- 
gre gating  probabilistic,  analyse  a  assume^  that  they  ditagme  only  because  of 
“noise , H  or  random  error,  in  the  assessment  process ;  hence.  It  yields  results 
which  do  not  reflect  the  possibility  that  different  analyses  have  drawn  on 
different  evidence,  Ue  suggest  that  from  e  psychological  point  of  view,  dif¬ 
ferent  analyses  may  tap  different  portions  of  out  store  of  knowledge,  oven 
when  performed  by  the  same  Individual,  Thsce  points  are  amplified  in  Cohen  et 
al, ,  1984,  and  in  a  planned  paper  by  Cohen  and  Lindley , 

Mammary.  Bayesian  probability  theory  is  strong  in  the  formal  aspects  of 
validity.  Its  logical  foundations  are  perhaps  uniquely  compelling  in  applica¬ 
tion  to  the  concept  of  chance.  li(?wever ,  the  input  and  computational  burdens 
which  it  imposes,  except  when  specialised  models  are  adopted,  are 
considerable.  It  has  no  adequate  resources  for  representing,  the  quality  of  an 
inferential  argument,  and  requires  an  arbitrary  degree  of  precision  in  numeri¬ 
cal  judgments.  Even  its  validity,  in  a  more  infernal  sense,  can  be 
questioned,  Bayesian  theory,  as  it  stands,  implies  that  one's  beliefs  should 
be  coherent  but  provides  no  guidance  for  choosing  among  alternative  equally 
coherent  analyses.  Moreover ,  by  assuming  that  all  assessments  are  based  on 
the  same  evidence,  it  closes  off  the  most  promising  source  of  such,  guidance, 

We  have  argued  that  the  application  of  Bayesian  theory  to  a  problem  is  not 
linear  process  in  which  conclusions  are  computed  from  Inputs,  It  is  for  often 
should  be)  an  Iterative  bootstrapping  process  in  which  comparison  of  conclu- 
s ions  arrived  at  by  different  methods  leads  to  revision  of  Inputs  and 
assumptions,  until  overall  plausibility  is  maximized.  Ibis  process  of  revis¬ 
ing  probability  assessments  should  be  guided  by  a  judgment  of  their  quality, 

A  mtnra  satisfactory  itt&unt  of  coaplctmnasf  of  evidence  ia,  therefore, 
essential . 

2 , 2 , 2  Belief  functions ,  Na Cure  of  the  theory .  In  the  theory  of  be 1 id f  func - 
tions  introduced  by  Shafer  ( 19 76),  Bayesian  probabilities  are  replaced  by  a 
concept  of  evidential  support.  The  contrast T  according  to  Shafer  {193 11; 
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Shafer  and  Tver sky,  1933}  la  between  the  chance  that  a  hypothesis  is  true,  on 
the  one  hand,  and  the  chance  that  the  evidence  means  (or  proves}  that  the 
hypothesis  la  time,  on  the  other.  Thus,  we  shift  focus  from  truth  of  a 
hypothesis  to  the  evaluation  of  an  evidential  argument,  as  a  result,  the  sya- 
tom  (a}  is  able  to  provide  an  explicit,  measure  of  quality  of  evidence,  (b)  is 
lesa  prone  to  require  a  degree  of  definiteness  in  inputs  that  exceeds  the 
knowledge  of  the  expert,  and  (c)  permits  segmentation  of  reasoning  into 
analyses  that  depend  on  independent  bodies  of  evidence. 

In  Shafer's  system,  the  support  for  a  hypothesis  and  for  its  complement  need 
not  add  to  unity.  For  example,  if  a  witness  with  poor  eyesight  reports  the 
presence  of  an  enemy  antiaircraft  installation  at  a  specific  location,  there 
ia  a  certain  probability  that  his  eyesight  was  adequate  on  the  relevant  ecca- 
sion  and  a  certain  probability  that  it  was  not,  hence,  that  the  evidence  is 
irrelevant.  In  the  first  Case,  the  evidence  proves  the  artillery  to  there. 

In  neither  case  Could  the  evidence  prove  the  artillery  is  not  there. 

To  the  extent  that  the  sum  of  support  for  a  hypothesis  and  ita  complement 
fall*  short  of  unity,  theta  it  "uncoimatcted"  support,  i.e.,  the  argument  hated 
on  the  present  evidence  it  unreliable.  Evidential  support  £*r  a  hypothesis  is 
a  lower  hound  on  tha  probability  of  Its  being  true,  since  the  hypothesis  could 
be  true  even  though  our  evidence  fails  to  demonstrate  it.  The  upper  bound  is 
given  by  supposing  chat  all  present  evidence  that  is  con  si l tent  with  the  truth 
of  the  hypothesis  were  in  fact  to  prove  it.  The  interval  between  lower  and 
upper  bound*,  i  ,  e  ,  „  the  range-  of  permissible  belief,  thus  reflects  the  un¬ 
reliability  of  current  argument* ,  This  concept  it  closely  related  to  com* 
pjeteness  of  evidence,  since  the  more  unreliable  an  argument  is,  the  *ot« 
changeable  the  resulting  belief*  are  as  new  evidence  {with  as  son  laced 
arguments)  are  discovered.  These  concepts  are  not  captured  by  Bayesian 
probabilities, 

Tn  Shafer's  calculus,  support  nf ■ }  la  allocated  not  to  hypotheses,  but  to  sets 
of  hypotheae*,  Shafer  allows  uj,  therefore,  to  talk  of  the  support  we  can 
place  in  any  subset  cf  the  set  of  all  hypotheses.  In  the  case  of  three 
hypotheses,  Hj_,  Hj  and  Hg,  for  cXsmpls,  We  could  allocate  support  to  Hj,  Kj. 
tlj,  {ftj  or  H^I  ,  iH]_  or  H^}t  IH2  or  H^lt  and  1Hj_  or  Hj  ox  As  with 

probability,  the  total  support  across  these  subsets  will  sum  to  1,  and  each 
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support  «(')  will  be  between  0  and  1,  It  Is  natural,  then,  to  say  thet  m(l) 
gives  tb*  probability  chat  what  the  *vidptidfl  mAfld*  is  eh*t  th*  truth  Li*s 
scmc-vfhf.ro  in  the  indicated  subset. 

Suppose,  for  example,  that  we  know  in  the  case  of  thms  hypotheses  that  TE-q  is 
false,  but  have  no  evidence  to  distinguish  between  11^  and  Hj.  In  that  Case, 
we  would  put  »C$H-^  or  -  lp  and  e, Lv-n  tore  support  to  all  the  other  pos¬ 

sible  subsets.  Alternatively,  we  may  feel  that  the  evidence  either  means  that 
H|j  is  true,  or  that  [Hj  or  Hj)  is  true,  or  that  It  is  not  telling,  us  anything 
(i.e, ,  {(Tj  or  °r  ttj)  is  true),  and  that  the  weight  of  evidence  is  Just  as 
strong  with  each  possibility.  In  that  case  m(Hj)  -  m(('K|  or  Hj))  -  or 

Of  H^))  -  1/3.  In  a  Bayesian  AhflljBlJ.  arbitrary  decision*  would  have  to 
be  made  about  allocating  probability  within  these  subsets,  requiring  judgment* 
that  ere  unsupported  by  the  evidence. 

This  sane  device,  of  allocating  support  to  subsets  of  hypotheses,  enables  us 
to  represent  the  reliability  of  probability  assessments ,  Suppose,  for 
example,  that  the  presence  of  feature  X  in  a  signal  is  associated  with  an  SA-4 
704  of  the  time  and  with  other  threats  3Q4  of  the  time,  based  on  frequency 
data  from  a  set  of  previous  signal  analyses.  If  we  are  confident  that  an 
image  now  being  analyzed  is  representative  of  this  set,  we  may  have  m(SA-4)  — 
.7  and  m( Other)  —  ,3,  But  if  there  is  reason  to  doubt  the  relevance  of  the 
frequency  data  to  the  present  problem  (s.g.,  due  to  possible  presence  of  ECM 
in  the  region)  ,  We  may  tfiscotint  this  support  function,  by  allocating  sane  per¬ 
centage  of  support  to  the  universal  set.  For  example,  with  a  discount  rate  of 
304,  we  get  m(5A-4)  -  .49,  m{ other)  -  .21  ,  and  m  ((SA-4,  other))  -  ,30,  The 
latter  reflects  the  chance  that  the  frequency  data  is  irrelevant. 

Shafer rs  belief  function  Belt ' )  summarizes  the  implications  of  the  e{ 1 )  for  a 
given  subset  of  hypotheses.  Bel(A)  is  defined  as  the  total  support  for  all 
subsets  of  hypotheses  contained  within  A;  in  other  words,  Bel {A}  is  the  prob¬ 
ability  that  the  evidence  implies  that  the  truth  is  in  A.  The  plausibility 
function  Pi ( ' )  is  the  total  support  for  all  subsets  which  overlap  with  a  given 
sub se  t . 

Thus,  PI (A)  equals  1- Be 1(A);  i.e,,  the  probability  that  the  evidence  does  not 
imply  the  truth  to  be.  in  ftot-A,  In  one  bf  the  examples  above,  with 


-  “OHj  or  -  n(lM1  or  H2  or  H3J)  -  1/3. 

wo  get: 

-  mWy)  -  1/3]  Pl(li3>  -  l-ftel(LHt  or  H2J)  -  1 
Bol^  or  H3))  -  bl(Hj)  +  m< H H-l  or  Hjl)  -  a/3; 

PI  Oil!  or  H3J)  -  l^eia^l)  -  1. 

B&mps ter ' s  rule.  Thus  far.  we  have  focU&od  On  the  representation  of  uncer¬ 
tainty  lit  Shafer’ a  system.  Fat  it  SO  be  a  useful  calculus,  nfe  need  a  ptocs- 
dure  for  infer ting  degrees  c£  belief  in  hypotheses  in  the  light  of  more  than 
one  piece  of  evidence.  This  is  accomplished  in  Shafer's  theory  by  Dempster' s 
rule..  The  essential  Intuition  is  simply  that  the  "Bwsning"  of  the  combination 
of  two  pieces  of  evidence  is  the  Intersection,  or  coiroon  element,  of  the  two 
subsets  Constituting  their  separata  inaanl ngs ,  For  csseiple,  if  evidence  Ej- 
proves  lH]_  or  H2>  ,  end  evidence  E^  proven  {tfj  or  Mj}  h  then  the  combination  E-^ 

+  proves  Since  the  t-uo  pieces  of  evidence  are  assumed  to  be 

Indepetuletiit,  clw  probability  of  atiy  given  combination  of  meanings  is  the 
product  of  their  separate  probabilities. 

bet  it  be  a  set  of  hypotheses  Hj.  Hj . and  write  2X  for  the  power  set  of 

X,  that  is,  the  set  of  all  subsets  of  X.  Thus-,  a  member  of  2s  will  be  a  sub¬ 
set  of  hypotheses,  such  as  [Et^,  Kg,  Hy> ,  Kg,  or  lH]_>  H2'  H3-  *tc'  Th*" 

if  is  the  support  given  to  A  by  on*  piece  of  evidence,  and  is  the 

support  given  by  a  second  piece  of  evidence,  Dempster'*  rule  is  that  the  sup¬ 
port  chat  should  he  given  to  A  by  eh*  two  pieces  of  evidence  Is: 

A  jfli  Aj— A 

- - ■ 

1  -  I 

The  numerator  here  is  the  sum  of  the  products  of  support  for  all  pairs  * f  sub¬ 
sets  A^ „  Aj  whose  intersection  is  precisely  A.  The  denominator  Is  a  normaliz¬ 
ing  factor  which  ensures  that  sums  to  1,  by  eliminating  support  for  im¬ 

possible  combination* , 
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Consider,.  for  example,  the  following  two  support  function*: 


Table  2-1 


UjT) 

Tfl2(  ' 

*12^  > 

Hj 

0.2 

0. 1 

0.344 

h2 

0.1 

0.3 

0.2SO 

#1 

0.3 

0 

0.172 

0.1 

0.3 

0.123 

H1H3 

0.2 

0 

0.0$3 

h2h3 

0 

0,1 

o.oie 

h2h3 

0,1 

0,2 

0.031 

In  the  third  column,  we  have  used  Dempster's  rule  to  compute  m-^(L), 


ample 


For  er- 


mx  (  HlH2  5  k2  (H1H2  J+e^  (KjH^  )  m2  C  >  +“1  i  H1H2H3 )  a2  { H  ^  > 

- - - - ■ - 1.c  - - - - - 

where 

C  -  ibi<;H1>[il2{H2>  +  td2(H3>  +  PLjOtjH^)]  +  [E2<Hj>  4  (H^)  + 

+  +  nij  (H?)  +  +  m]LtH1Ha)n2(B3)  +■  ^  *n2  C  «2  5 


and  so 


,  1x0 .3+0 , 1x0 . 2+0 . 1x0, 3 

i~  o'TT 


0.125. 


Let  us  now  examine  the  performance,  or  at  least  the  potential,  of  Shafer's 
theory  within  our  evaluation  framework. 

Feasibility :  Quantity  of  Inputs,  One  of  the  main  difficulties  standing  in 
the  way  of  a  Bayesian  analysis  Is  Its  complexity.  At  first  sight  the 
Sh&feT i an  approach  seems  simpler „  since  complicated  Independence  Judgments  and 
conditional  probability  assessments  appear  not  to  be  required.  Thi*  ap¬ 
pearance  ia  illusory,  Support  functions  must  be  assessed  over  not  Just  the 
hypothesis  set,  but  over  the  power  set  of  the  hype  chests  Set.  Ui'th  10 
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hypotheses,  for  example,  the.  support  distribution  hss  1*023  e lenient sL  For 
both  Bayes lan  and  Shafer Ian  models ,  the  required  number  of  assessments  or 
Judgments  increases  exponent i ally  with  the  number  of  events  or  hypotheses.  To 
see  the  parallel,  compare  the  Bayesian  rule: 

Pr[A  or  Bj  -  Pr[A]  +  Pr[B]  -  Fr [A] Pr[B | A] 


with  Shafer1 $  rule; 


Bel {(A  or  Bj>  -  m(A)  *  m{B)  +  te({A  or  B))„ 

In  each  upje,  to  get  an  uncertainty  measure  for  a  disjunction  (£.*.,  a  fflMber 
of  2t)„  we  Enuat  make  one  assessment  In  addition  to  the  measures  already 
assessed  for  the  elements.  For  Bayesians,  the  extra  assessment  is  a  Condi' 
t tonal  probability  Fr[B|Aj;  for  Shaferiatis  it  is  the  direct  evidential  support 
a({A  or  Bl), 

A  Shafer tan  re^penae  to  this.  In  parallel  with  the  Bayeilah  response,  is  that 
special 1**4  node I a  may  be  developed  that  require  far  fewer  assessment# ,  In 
fact,  the  belief  function  framework  admit*  a  variety  of  Interesting  special 
cues;  e.g-i 


•  simp  la  support  functions'1,  all  support  goes  either  to  some  one 
subset  or  to  the  universal  set  X,  Either  the  evidence  limits  the 
truth  to  lie  within  one  particular  subset  or  it  is  totally 
unreliable, 

*  discounted  probabilistic  support  functions:  all  support  goes  to 
individual  hypotheses  {as  in  a  standard  probability  distribution}, 
with  some  additional  support  possibly  going  to  the  universal  set  Y 
(reflecting  a  judgment  of  the  quality  of  the  evidence  for  the 
probability  distribution) ; 

•  consonant  support  functions:  all  support  goes  to  a  nested  serif? 
of  subsets  of  hypotheses;  i.e.,  the  evidence  points  in  a  certain 
direction  but  is  unclear  how  far  we  should  go; 

*  hierarchical  support  functions;  the  evidence  support#  subset#  of 
hypotheses  that  can  be  arranged  In  a  tree, 


Here  again,  however,  {as  in  the  Bayesian  case}  complex  end  difficult  judgments 
must  be  made  to  determine  that  a  particular  spccialited  model  is  applicable. 
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before  savings  in  quantity  of  assessments  cm  be  realized. 


The  problem  for  Shaferianji  may  even  be  deeper.  The  Applicability  of 
Ejenpsttr1  4  rule  to  two  bits  of  evident*  E-l  And  E^  tc  not  automatic.  It 
require?  rather  careful  and  difficult  tons ide t a  £ i on  of  a  whole  set  of  indepen¬ 
dent*  assumptions,  We  shall  return  to  this  point  in  out  ii sous* ion  of  the 
validity  of  Shafer's  theory, 

tfojSjpyta  Clonal  tree  tab  ilLtf.  tier*  again  rho  story  is  parallel  to  the  Bayesian 
cast.  Th*  employment  of  onr  0*  tr  to  to  d  belief  function  models  would  lfivolva 
prohibitive  computation,  A?  a  result P  Cordon  and  Shortliffe  {19 Si)  propose  to 
modify  Dempster" a  rule  to  simplify  COwputAtlon  in  JfYClN,  Shafer  (19E4a)  haa 
argued  in  response  that  .-id  hoc  modifications;  of  this  sort  might  h*  avoided  by 
a  control  strategy  that  intelligently  exploits  the  structure  of  restricted 
belief  function  models,  such  as  the  hierarchical  structure  proposed  for  HYCIH. 
Here  as  in  the  Bayesian  case,  feasibility  la  purchased  only  in  special  cases,, 
and.  evidsntly ,  at  the  cost  of  comp Lex  and  subtle  judgments  regarding  the 
structure,  of  the  overall  argument  l 

Validity,1  Seznajitios.  Shafer  argues  that  the  requirement  for  a  behavioral 
specification  of  probabilities  is  irrelevant.  People  bet  in  a  certain  way  be* 
cause  of  their  beliefs  end  preferences ;  observing  their  own  betting  behavior 
will  not  help  them  to  assess  those  beliefs,  Shafer  thus  urges  a  shift  from, 
the  positivist  Co  a  were  cognitive  orientation.  He  argues  that  uncertainty  is 
quantified  on  the  basis  of  an  analogy  between  one's  problem  and  a  "canonical 
example* ,  In  Bayesian  modeling,  we  assess  the  probability  of  an  event  by  com* 
paring  its  Likelihood  with  the  likelihood  of  a  frequency -based  event,  such  as 
a  random  drawing  from  an  urn.  Thus,  for  Shafer,  to  say  that  the  Bayesian 
probability  of  an  event  is  x  is  to  say  that  it  is  ’like*  the  chance  of  drawing 
a  white  ball  from  an  urn  with  a  proportion  of  white  balls  equal  to  x. 
Similarly,  to  say  that  your  Shafer tan  belief  in  a  proposition  is  y,  is  to  com* 
pare  it  to  canonical  examples  in  which  the  reliability  of  an  evidential  source 
is  determined  by  chance. 

Unfortunately ,  Shafer 1  £  position  is  weakened  by  two  considerations:  First, 
his  :«nonlo»l  examples,  as  we  shall  see  below,  art  far  more  complex  and  less 
obviously  usable.,  oven  from  *  cognitive  point  of  view,  than  the  Bayesian 
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examples.  Second,  behavioral  specif ieation  probably  plays  a  cognitive  role  in 
clarifying  the  sense  of  a  canonical  example,  For  example,  what  does  it  mean 
to  aay  that  ray  uncertainty  about  whether  an  object  is  a  building  ia  *liken  my 
uncertainty  about  drawing  from  an  um?  In  what  respects  aust  they  be  a  trailer"? 
Many  people  will  find  it  i lluxl natlng  when  told  it  means  that  I  would  bet  at 
equal  stakes  on  either  event. 

A  major  strength  of  Shafer’  s  theory,  nevertheless  ,  ia  the  naturalness  of  the 
input  format  it  imposes: 


a  Assessments  need  go  no  further  than  the  evidence  justifies.  As  we 
have  seen,  “ignorance"  is  naturally  represented  by  assigning  sup¬ 
port  to  a  subset  of  hypotheses,  with  no  further  coiEnitment  to  an 
allocation  within  the  subset.  A  Bayesian  must  decide  amor.g  quite 
definite  and  distinct,  but  equally  arbitrary,  allocations  of 
probability - 

*  Weight  ot  completeness  of  evidence  is  quite  intuitively  repre¬ 
sented  as  the  degree  to  which  the  sum  of  belief  for  a  hypothesis 
and  its  complement  falls  short  of  unity. 

*  Assessments  ray  be  baaed  on  distinct,  separable  bodies  of 
evidence,  rather  than  requiring- - as  in  Bayesian  theory- 'that  all 
assessments  be  based  on  all  the  evidence 


F«ce  validity,  Belief  function  theory  possesses  no  deep  axiomatic  Justifica¬ 
tion  comparable  to  the  do  FitWttl  and  Llndley  arguments  for  Bayesian  theory. 
Sot  coincidentally  ,  however  j  Shafer  has  offered  a  view  of  model  11  Vel i da t ion" 
which  contrasts  sharply  with  the  axiomatic  approach,  On  Shafer’s  view  (1961; 
Shafer  and  Tversky ,  1'9SS>1  theories  of  inference  are  tools  which  can  be  used 
to  help  us  construct  (rather  than  elicit  or  discover)  a  set  of  probabilities. 
The  justification  for  applying  a  particular  tool  to  a  particular  problem  is 
that  we  see  an  analogy  between  that  problem  and  the  canonical  example  underly¬ 
ing  the  theory.  For  example,  to  the  extent  that  the  Bayesian  theory  has  any¬ 
thing  to  contribute,  it  is  by  establishing  a  persuasive  analogy  between  your 
problem  and  a  situation,  like  drawing  ball*  frota  an  urn,  where  the  truth  ia 
genet* ted  by  hnown  chances „ 

Bayesian  analogies  of  this  sort,  according  to  Shafer,  will  usually  be 
imperfect,  because  in  the  canonical  example  we  know  the  rules  of  the  game  that 
determine  how  the  truth  is  generated  (e.g.  ,  the  composition  of  the  um  and  the 
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procedure  for  drawing  a  ball} „  In  real  problems,  there  are  nearly  always  many 
aspects  of  the  situation  where  comparable  rules  cannot  be  given  without  flaking 
numerous  aasuaptloua,  When  these  assumptions  become  very  extensive,  it  may  be 
hnttar  to  switch  to  a  simpler  kind  of  model,  which  is  more  plausible  despite 
not  giving  a  complete  picture  of  how  the  truth  In  generated.  Such  simpler 
models  can  ho  based  on  canonical  examples  in  which  the  meaning  of  th«  evidence 
rather  than  the  truth  is  generated  by  known  chances. 

We  comment  On  'Shafer  fs  position  at  two  level*:  First  *  hw  convincing  Is  hi  a 
concept  of  validity?  Et^erd,  how  plausible  cr  useful  are  the  canonic el  ex* 
jingles  unde t lying  belief  functions? 

Concept  <>f  validity,  Fut  Shaferi  validity  reduces  to  face  validity  and 
plausibility  of  instances.  His  argument  for  this  position,  hovavat contains 
suite  confusion.  Shafer  mistakenly  assumes  chat  the  adoption  cf  an  axiomatic 
framework  implies  a  belief  in  pre-existing  rather  than  constructed 
probabilities.  Thus,  Shafer  (1034a)  spaaks  derisively  of  assessment  in  the 
Bayesian  context  as  "pretending*1  that  one  already  has  probabilistically 
coherent  beliefs  and  preference* ,  and  then,  somehow,  ''trying  to  figure  out 
what  they  are ,  p 

Our  own  view  Is  that  Shafer  is  correct  to  regard  probability  frame works  as 
tools  for  the  construction,  rather  than  discovery,  of  probabilities ,  But  he 
is  wrong  in  supposing  that  the  axiomatic  derivation  of  a  framework  detracts 
from  this  role- -as  long  aa  we  understand,  as  argued  above,  that  axiomatic 
derivation  is  only  one  argument  in  favor  of  a  given  framework.  If  taken 
seriously,  Shafer1*  argument  would  declare  as  "non- constructive”  any  set  of 
prior  constraints  on,  the  way  uncertainty  Is  represented  or  manipulated;  thus, 
it  applies  as  strongly  ag*tu*c  belief  functions  and  Eewpster's  rule  as  to 
Bayesian  probabilities.  The  solution  In  our  view  is  not  tu  drop  constraints, 
but  to  drop  the  view  chat  any  particular  set  of  constraints  is  inevitable. 
Thus,  probability  assessment  as  we  understand  it  is  an  iterative  and  construc¬ 
tive  process,  in  which  a  tentative  framework  (e.g. ,  Bayesian  or  Shafer ian)  is 
adopted,  assessments  ate  made  within  the  framework,  checked  for  consistency, 
and  revised;  if  the  overall  result  is  unnatural  or  implausible ,  the  framework 
itself  nay  be  rejected  or  revised,  In  other  words,  "pretending*1  that  a 
framework  Is  correct  is  a  legitimate  strategy  In  uncertainty  assessment; 
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indeed*  it  is  the  only  possible-  strategy,  A  framework  la  of  use  as  a  tool 
precisely  because  it  doeff  impose  { t«nt* t ive )  constraints  on  the  assessments 
that  ate  produced.  It  challenges  the  expert  to  actively  shape  a  previously 
disorganized  and  perhaps  evetl  drive  rbal  tied  set  of  belief  a.  It  serve  a  as  a 
medium  or  language  in  which  the  expert  “thinks"  about  uncertainty  and  In  which 
he  expresses  those  thoughts.  A  supposedly  "neutral*  framework,  that  Imposed 
no  format  or  structure,  beyond  that  already  present,  would  not  help  the  expert 
in  the  process  of  construction  and  could  not  advance  his  or  cut  understanding 
of  his  beliefs.  {See  Cohen.  Havoc,  and  Kidd,  198 'i ,  for  a  more  general  argu¬ 
ment  in  the  context  of  knowledge  engineering.) 

In  sum,  Shafer's  argument  for  a  constructive  process  of  probability  assessment 
is  correct.  But  he  appears  to  have  drawn  two  unnecessary  conclusions :  (I)  It 

in  no  way  contradicts  the  added  plausibility  that  aay  he  lent  to  a  framework 
by  the  existence  of  an  axiomatic  derivation;;  and  (2)  it  should  not  blind  us  to 
the  importance  of  the  iterative  strategy  of  tentatively  adopting  a  framework 
and  testing  Its  implications. 

Shafer'S  canonical  example.  As  noted  above,  when  we  apply  a  belief  function 
analysts,  wo  ’'pretend"  that  the  meaning  of  the  evidence  is  generated  by  known 
ehancci.  Tn  order  to  evaluate  Shafer’s  theory  in  terms  of  face  validity,  we 
must  examine  this  analogy  mote  closely,  In  particular,  we  must  focus  on  the 
independence  assumptions  embodied  in  the  canonical  example  which  are  required 
to  license  an  application  of  hfempiter 1  a  rule.  It  turns  out  that  these  assump¬ 
tions  are  the  primary  constraints  Imposed  by  Shafer’s  theory  on  the  process  of 
evaluating  evidence J  hence,  they  are  its  main  contribution  to  the 
“construction"  of  probability  judpucnts.  They  have  also  been  the  major  source 
of  controversy  between  Shafer  and  Bayes Ians.  Early  critics  of  Shafer's  work 
{e.g. ,  Williams,  1976)  Complained  About  the  obscurity  of  Shafer's  notion  of 
" independent  evidence,’’  In  a  recent  paper,  however.  Shafer  {in  press)  has 
clarified  this  Concept  considerably. 

Shafer's  interpretation  of  belief  functions  Involves  two  sets  of  hypotheses 
{or  "frames")  as  shown  in  Figure  2*1.  One  frame,  S,  is  a  set  of  background 
hypotheses  which  concern  the  state  of  the  process  that  produced  the  evidence 
at  hand.  For  example,  If  the  evidence  E^  is  a  witness' «  testimony  that  he  saw 
antiaircraft  artillery  In  a  certain  location,  the  frame  $  flay  *tttply  be  the 
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two  posalbil teles  {the  witness  is  reliable,  the  witnes*  t*  not  reliable}.  The 
ether  frame,  T,  contain*  the  hypotheses  of  primary  interest,  e.gr,  (the  artil¬ 
lery  Is  present,  the  Artillery  la  not  present),  To  get  a  belief  function,  we 
only  need  <i)  A  prob^h il i ty  distribution  over  $,  I-*,,  standard  probabilities 
Pj  and  Tj,  for  th*  reliability  and  unreliability  Of  the  wttnes*;  and  { 1 1 )  a 
mapping  from  S  Co  T  based  Oft  the  Content  of  the  evidence.  S-ltite  che  ^vldAnua 
is  the  witness's  report  of  artillery,  reliability  in  S  riap&  OTite  [the  artil¬ 
lery  is  present]  in  T}  unreliability  In  S  mapE  onto  the  set  nth*  Artillery  is 
present,  the  artillery  is  not  present]  in  T.  Support  tti (A )  for  A  subset  A  in  T 
is  just  the  probability  for  hypotheses  in  S  that  map  only  onto  A,  (We  have 
referred  to  this*.  somewhat  loosely,  as  the  probability  that  the  evidence 
"means IK  A> ,  Bel  (A)  for  a  subset  A  in  T  is  the  sum  oC  the  probabilities  for 
hypotheses  in  S  that  map  onto  subsets  of  T  that  are  contained  in  A.  Thus,  in 
our  example,  Bel (artillery  is  present)  —  P-^  ’  Bel ( [present,  not  present 11  — 

Ei  +  f2, 

Suppose  we  now  receive  a  second  piece  of  evidence,  E2,  which  is  the  testimony 
of  a  second  witness  that  he  saw  artillery  in  the  same  vicinity.  We  define  a 
new  belief  function  for  this  witness  by  specifying  a  franc  Sj  with  the  ele¬ 
ments  (the  second  witness  is  reliable,  the  second  witness  Is  unreliable} ,  and 
by  Assessing  probabilities  -and  Pj‘  over  Sj,  What  is  out  new  overall 
belief  in  the  elements  of  T?  Naming  5  as  Sj,  Figure  2-2  shows  a  new  frame. 
S^kSj,  which  result*  from  combining  elements  of  and  S2.  Each  cell  has  a 
probability  which  la  the  product  of  Che  probabilities  of  the  elements  from  S2 
end  S2;  and-  each  cell  is  mapped  onto  a  subset  of  hypotheses  in  T,  based  on 
knowledge  of  E|  and  E2 .  According  to  this  mapping  (as  shown  by  the  labels  in 
the  cells) ,  support  for  the  artillery  being  present  equals  the  chance  that 
either  witness  1  or  witneas  2  is  reliable,  i„e.,  F^P^'  +  P2F2'  +  This 

is  the  result  given  by  Dempster’s  rule, 

Whac  if  the  report  of  the  second  witness  contradicts,  rather  than  confirms, 
the  first?  That  isa  is  a  report  that  artillery  is  not  present  in,  the 
Specified  location,  In  chut  case,  the  new  frame,  S^siSj,  appears  as  in  Figure 
2-J,  The  only  change  is  in  Che  Happing  nf  the  cell*  to  subsets  in  T^-a  things; 
requited  by  the  change  In  E2 -  It  turns  out,  however,  that  the  ce  11  cor¬ 
responding  to  both  witnesses  being  reliable  docs  not  m^p  to  any  subset  in  T, 
Sluts  and  Ej  are  contradictory,  both  cannot  be  true.  Thus,  we  use  our 


Figure  2  — ? s-  Canonical  EKampLe  foi:  Combination  of  Concurring  Evidence 


Witnes-s  1 


yigtre  2-3:  Canonical  Example  for  Ccuftbifta-tlon  o £  Conflicting  Evidence, 


Figure  2- Support  Fisfittiona  to  Illustrate  Combln-at-lOft  of 
Conflict  tup,  Evidence  by  Dempster's  Rule 
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knowledge  of  and  E-,  to  prune  out  impossible  cells  in  S^xS^  An  cording  to 
the  capping,  support  for  ax Cillery  being  present  equals  Che  chance  that  wit- 
ness  1  ia  reliable  and  witness  2  ie  unreliable ,  l,et ,  E^Pg'/Cl-P^E^' ) nor¬ 
atallsing  to  remove  tha  Impossible  case..  Once  again,  this  is  the  result  of  ap¬ 
plying  Dempster’s  rule. 


In  many  of  Shafer's  discussions,  he  appears  Co  argue  Chat  Dempster's  rule  is 
Justified  in  situations  which  "resemble"  this  canonical  example,  because  it  is 
the  correct  rule  for  the  example  (Just  as  Bayesian  rules  are  correct  for  the 
cace  of  drawing  balls  from  an  urn),  fiut  what  makes  it  correct?  Even  these, 
simple  examples  may  seen,  too  complex  for  such  a  direct  appeal  to  intuition,  A 
recent  paper  by  Shafer  (in  press)  contains  a  more  extensive  discussion  of  the 
preconditions  of  Dempster's  rule,  Ue  can  use  Dempster's  rule,  he  says,  only 
if  the  following  Judgments  are  made’ 


(a)  Before  tons tde rat top  of  the  (tapping  to  t.  any  hypo the* i*  in  £± 
compatible  with  any  hypothesis  in  5p  (so  y.xS^  can  be  defined  a*  a 
new  frame) , 

(b)  Probabilities  for  elements  of  S ^  are  independent  of  elements  in  S 
(e.g.,  we  do  not  alter  our  estimate  of  the  reliability  of  one  wit¬ 
ness  based  on  the  reliability  ox  unreliability  of  the  other 
witness) , 

(c)  If  we  could  draw  a  conclusion  about  the  truth  of  a  subset  in  T  by 
knowing  Chat  a  certain  combination  of  hypotheses  from  £|  and  S-, 
was  the  case,  then  we  could  have  drawn  the  same  conclusion  by 
knowing  that  either  one  ot  the  other  of  Che  hypotheses  (from  5-  or 
^2>  was  the  case,  (In  the  example  of  concurring  witnesses,  we  can 
conclude  that  artillery  is  present  if  both  witnesses  are  reliable1; 
but  all  we  needed  was  one  or  the  other  to  be  reliable), 

(d)  The  evidence  we  use  for  assessing  S |  and  £  -  tells  us  nothing  more 
directly  about  T,  (All  the  work  of  reasoning  about  T  is  trans¬ 
ferred  to  reasoning  about  S.) 


Having  enumerated  these 
about  the  rationale  for 
de.rannatrated  in  any  way 
pracondi ti on* ,  Perhaps 
tion*  are  met,  Dempster 


assumptions,  we  must  remark  that  our  original  question 
Dempster’s  rule  remains  unanswered,  It  ha*  not  been 
that  Damp s tar f  a  rule  "'follows  free"  the*e 
Shafer  mean*  simply  that  when  these  particular  tofidl- 
s  rule  will  appear  more  plausible  or  natural. 


Jf&te,  however, 


that  the  canonical  situation  described  by  Chose  condt Cions  in- 
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eludes  a  chance  modal:  Because  of  assumptions  (a)  and  lb) t  the  probability 
foe  a  component  of  5^x&2  Is  simply  the  product  of  the  probabilities  assigned 
to  the  components  o£  and  S-j .  It  is  tempting,  therefore,  to  view  the  belief 
function  model  as  a  special  case  of  a  Bayesian  analysis „  defined  by  the 
testr ictions  outlined  in  (a)  -  (d) .  In  that  case,  Dempster's  rule  should  be 
justifiable  from  {a)1  -  fd>  by  the  rules  of  probability  theory.  Wo  re  over, 
Shafer's  model  would  then  inherit  the  axiomatic  Justification  of  the  Bayesian 
model  In  the  special  cl rcumstanoes  where  it  applied. 

A  Bayesian  foundation  for  belief  functions 7  To  see  how  this  might  work,  con¬ 
sider  the  simple  case  of  Figure  2-2,  with  H  *■  the  artillery  is  present,  h  - 
the  artillery  is  not  present h  El  -  the  first  Witness  Is  reliable,  and  R  -  the 
first  witness  ts  nOC  reliable.  It  follows  from  ptcbahtlity  theory  that: 

Fr(H)  -  Pr(H|R)Pr(R>  +  FrOi|R>Pr(£> . 

Following  Shafer1*  definitions,  we  interpret  n(!t)  at  Fr(R)  and  m(H  or  11)  as 
Pr(R),  In  addition,  from  our  knowledge  of  Ej  (1,*,,  the  mapping  item  5j_  to  t 
which  it  establishes),  and  using  (d) ,  we  V-nv**  that  Fr(H[fD  -  1;  if  the  witness 
t*  r«l labia,  then  the  artillery  is  present,  Hence,  we  nay  write 

FrCtf)  -  ID  (if)  +  rr{H|k)  mCH  or  H) 


and  this  gives 


Be 1(H)  -  m(H)  <  Pr(h)  <  or  H)  -  Fi(K) , 

where  £el(H}  and  PI (H)  are  Shafer’s  belief  end  plausibility  function*.  It 
appears,  then,  that  the  belief  function  analysis  is  simply  an  Incomplete 
Bayesian  analysis-.,  Our  uncertainty  about  Pr(H)  is  due  to  cur  failure,  in  the 
belief  function  approach,  to  specify  Fr(H|R),  i.e,,  the  chanee  of  the 
hypothesis  being  true  despite  the  fact  that  the  present  evidence  is 
unreliable.  This  is  Just  another  way  of  saying  that  Shafer  la  interested  in 
the  proof  of  the  hypothesis,  not  Its  truth.  If  Fr(H|R)  -  0,  hr(H>  «  Bel(K) ; 
and  if  ?r(Hpl)  -  1,  Pr(H)  -  PI  (K) .  Thus,  Bel{H)  and  R1(H)  give  lower  and  up¬ 
per  bounds  for  the  Bayesian  probability. 
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Let  us  now  see  how  Dempster's  rule  works  within  this  Bayesian  interpretation. 
Let  EL}  end  refer  to  the  reliability  of  the  first  and  second  witness, 
respectively,  end  teke  the  cese  where  end  E^  agree.  A  Bayesian  probability 

Fr-C  I")?  Is  u  function  of  two  arguments ,  the  event  and  the  evidence. 

Presumably 1  therefore,  in  using.  Dempster*  S  rule,  the  probability  to  be  bounded 
is  Pr{H|E^,E2),  Let  ua  for  the  moment n  however,  Ignore  this  consideration  and 
use  Pr(B) r  (Slote  that  in  the  caee  of  one  piece  of  evidence,  we  likewise  used 
Pr{H)  instead  of  Pr(H|E^),}  By  probability  theory,  we  have 

Fr(H>  -  Fv<H|l4  or  R2)FvCRL  or  ft2>  +  FraURfor  or  V’ 

Substituting  based  on  conditions  (a)  and  {fa)  ,  we  have 
PrtH)  -  Pr^HI^  or  Rj> |Pr +Fx (R£ ) -Fr (Rj) Pr (Rj ) ]  +  Pr (H | ) Pr f Rj >Pr<R2 >  , 
By  Hemp e tot's  rule, 


ml2(U)  -  Pr^)  +  Fr(R3)  -  Pr^Pr^ ) 
and  by  Shafer’s  definitions, 

■12tH  or  -  PrtR-^FrtRj). 

Using  (c)  and  (d)  and  the  mapping  from  S^hS^  to  T,  PrfHlR^  or  Rj)  —  1. 
Therefore. 


Fr{H)  -  aL2(H>  +  Pr fH (Rjljjmj 2 fH  or  H)  - 


It  follows  that 

Bel12(H)  -  £  Pr(H>  5  ml2(H>  +  nL2(H  or  K)  -  P112(H). 

Thus  r  hl(H}  and  P1(H>+  when  computed  by  Dempster's  rule,  continue  to  give  up¬ 
per  and  lower  bounds  for  Pr(H),  (Mote,  however,  that  &ei( ' )  and  Pi ( ' )  are  not 
bounds  on  what  the  future  probability  could  he,  given  further  evidence,  They 
are  bounds  on  Fr(')  implied  by  our  present  evidence,)  A  similar  demonstration 
can  be  given  for  the  case  where  E^  and  Ej  conflict.  This  approach  can  be 
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generalised,  tv  the  case  where  Support  Is  assigned  tv  arbitrary  sublets  oE 
hypotheses  by  regarding  "'reliability*  Da  a  set  of  separately  assessed  skills 
Involved  In  discriminating  subsets  of  hypotheses  from  their  complements  . 

The  problem,  of  course,  Is  that  We  have  not  Justified  Dempster's  rule  as  a 
bound  on  the  Bayesian  probability,  ?r<HlE^Ej>,  When  we  cond  It  ltmalize  on  the 
evidence,  as  we  certainly  must  In  a  Bayesian  analysis,  Pr(R,  dt  Kj)  Is  re¬ 
placed  by 

Fr-^R-L  or  R2jE1E2>  -  Pr(R1|E1R2)  +  PrCfe^C-^)  -  Pr(R1|E1Ez)Fr{itz|E1E2R1)  . 


This  brings  out  a  Curious  and  critical  feature  of  Shafer's  theory .  He  is  as¬ 
king  u£  to  ASSCsS  the  reliability  of  a  Witness  (of  more  generally,  the  status 
Of  an  evidentiary  process)  without  taking  into  account  our  knowledge  of  what 
the  witness  said.  In  Shafer's  canonical  example,  knowledge  of  the  evidence 
enters  in  only  for  the  mapping  from  5  to  T,  after  all  the  probability  work  has 
been  done  on  S .  In  a  Bayesian,  analysis ,  on  the  other  hand,  the  credibility  of 
s  witness  can  be  shown  to  depend  both  on  what  is  said  and  on  its  prior 
probability,  I.e.,  our  original  tendency  to  think  It  true.  If  a  witness  says 
something  which  is  independently  believable,  Our  estimate  of  his  reliability 
increases.  More  importantly,  perhaps,  the  credibility  of  one  witness  can.  in 
a  Bayesian  analysis,  be  increased  by  corroboration  of  a  second  witness!  and 
decreased  by  contradiction. 

Assumption  (b)  Ie  plausible  only  in  light  of  this  restriction.  The  strict 
Bayesian  version  of  (b)  is 


Prt^lRjEgRj)  -  VrtylEjBg), 


Kote  that  EjR-l  implies  H,  i.e.,  If  witness  1  is  reliable  and  cays  H,,  H  is 
true.  But  Wc  Would  expect,  quite  generally,  that  FrCF^lEjtl)  >  Pr<R2 1  E^Ej)  , 
i . a . ,  learning  for  a  fact  that  what  the  witness  said  is  true  increase*  his 
credibility  more  than  corroboration  by  d  second  witness.  On  the  other  hard, 
if  we  are  assessing  a  Witness's  reliability  prior  to  (or  without  consideration 
of)  his  testimony,  it  does  make  sense  to  requite  that  his  reliability  be  inde¬ 
pendent  of  the  reliability  of  another  witness.  TJe  thereby  preclude  shared 
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uncertainti**  {*rE-j  e  conspiracy)  tp  the  evidential  prone****  being 
cowMtted, 

A  group  of  Swedish  re s earchftC Sh  whose  wnrh  Is  sumrar  1  zed  and  extended  In 
FreeLing  and  Sahltn  (15®1)  b  and  Froding  has  explored  issues  such  as 

this  u  Like  ShoEcr,  they  focus  on  the  reliability  of  the  evidence,,  rather  than 
the  truth  of  the  hypothesis,  1,6.,.,  they  reject  the  traditional  Bayesian  effort 
to  model  the  chance  of  a  hypothe*!*  When  tha  evidence  is  unreliable.  But  un¬ 
like  Shafer,  they  analyse  reliability  in  the  light  of  the  evidence,  aa  Fr<R| E) 
rather  then  Fr(R),  In  effect,  tht*  la  ap  effort  to  give  a  proper  Bayesian  ac ■ 
count  of  the  potion  of  quality  or  completeness  of  evidence,  rather  than  truth. 
(As  iueh,  it  is  an  alternative  to  the  idea  of  second- order  probabilities  dis¬ 
cussed  above)  The  upshot  of  this  research  ii  that  if  m(H)  is  equated  with 
Fr(R|E)  ,  Dempster's  rule  cannot  in  general  be  Justified,  Depending  on  the 
character  of  the  belief  functions  being  combined,  and  che  kinds  of  conditional 
dependence  assumed  in  the  Bayesian  analysis,  Deraps teTps  rule  nay  be  correct,  * 
good  approximation,  or  entirely  off  the  mark  in  comparison  to  the  * proper” 
Bayesian  rule  of  combination. 

While  ft  fails  to  fully  validate  Dempster1  s  rule,  the  Swedish  work  al.so  lacks 
aost,  if  not  all,  of  the  virtues  of  the  belief  function  representation.  In 
terms  of  feasibility,  formulations  which  conditional ire  cm  the  evidence  become 
extremely  complex  even  for  the  simplest  examples.  The  Swedish  group  hp&  made 
little  progress  in  deriving  rules  for  the  combination  of  evidence  involving 
the  full  range  of  cases  to  which  Dempster's  rule  applies,  in  particular,  where 
varying  degrees  of  support  are  assigned  to  arbitrary  subsets  of  hypotheses. 
Hare over,  the  requirement  to  assess  prior  probabilities  is  Incompatible  with 
the  segmentation  of  evidence  which  is  vital  for  the  naturalness  of  inputs  in 
Shafer’s  system, 

Shafer  {in  press)  explicitly  rejects  the  attempt  to  provide  any  sort  c£ 
Bayesian  foundation  for  belief  functions,  Argument*  based  on  Dempster1*  rule 
"have  thfrlr  own  logit” ’-based  on  the  appropriate  canonical  example*  and  an  in¬ 
tuitive  conviction  that  the  appropriate  conditions  of  Independence  are 
satisfied.  As  noted  above,  Shafer’s  appeal  to  intuition  has  not  entirely 
succeeded  in  making  that  “logic"  clear.  We  propose,  however,  that  it  cap  be 
clarified.  In  opposition  to  both  Shafer  and  the  Bayesian*,  we  would  argue  ’-He 
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*eriti  ef  the  p send* - Bayea Ian  Analysis  cf  3  u  1  (  '  )  end  Pl(')  us  bounds  on  Pr< ' ) 7 
which  Vr.  illustrated  in  this  section,  It  falls  CG  derive  Dempster" a  rule  as  a 
special  Gate  of  probability  theory,  Nonetheless ,  it  clarifies  eh*  relation¬ 
ship  of  Danpacer1*  rule  to  Che  canonical  example,  by  an  argument  that 
resembles  a  Valid  Bayaslin  argument  in  moat  respects.  Moreover,  the  dis¬ 
similarity  can  be  crisply  and  clearly  stated;  the  argument  concerning 
reliability  la  conducted  without  consideration  of  the  content  of  the  evidence, 
The  latter  can  be  regarded  as  an  explicit  decision,  justified  by  enormous 
gains  in  the  simplicity  and  power  of  the  calculus  l  This  is  not  equivalent, 
however,  to  «  fixed  belie!  that  the  content  of  evidence  la  irrelevant.  In  an 
iterative,  bootstrapping  system,  we  can  guard  against  the  pitfalls  of  that  as¬ 
sumption  by  Continually  reexamining  it  aa  an  analysis  proceeds.  In  Section  3 
v«  explore  the  design  of  a  system  in  which  the  function  of  recalibrating 
sources  of  evidence  in  light  of  corroboration  or  conflict  is  assigned  to  a 
process  of  qualitative  reasoning. 

£oie  of  thtf  sixuii^pcicvi*  in  constructing  an  analysis.  Conditions  (bj  and  (c) 
pi Ay  Aft  important  role  as  Constraints  In  the  Construction  of  a  belief  function 
analysis,  Violation  requires  reassessment  of  the  overall  structure  of  an 
analysis,  redefining  frames  for  either  S  ct  r  ot  both  (of,,  Shafer,  1964a) , 

(c)  says  that  elements  Erata  both  witnesses "  testimony  must  rot  be  required  In 
order  to  construct  a  chain  of  reasoning  that  gets  us  to  T,  Far  example,  if 
gne.  witness  said  p  and  the  Other  said  p^,  we  would  need  to  nssuww  both  ware 
reliable  to  infer  q.  There for*,  these  ^tue  Statements  oust  be  counted  as  parts 
Of  a  single  evidential  argument.  In  this  sense,  Dempster's  rule  combines 
self-contained  "arguments"  rather  than  "bits"  of  evidence.  And  application  of 
the  rule  presupposes  a  more  global  process  of  reasoning  addressed  to  problem, 
structuring. 

(b)  and  tejj  represent  a  limitation  on  Dempster's  rule  In  a  second  sense;  Once 
our  evidence  has  been  segmented  into  independent  arguments ,  wo  can  combine  it 
by  Dempster's  rule,  but  that  rule  tells  us  nothing  about  how  two  dependent 
pieces  of  evidence  should  be  combined  within  a  self-contained  argument. 

Clear iy,  in  any  expert  system  application,  Dempster's  rule  must  be  supple¬ 
mented  by  other  forms  of  inference.  Interestingly,  in  a  recent  paper,  Shafer 
<19S4)  himself  suggested  that  expert  Systems  will  have  Co  sake  provision  Cot 
dependent  evidence ,  and  that  the  full  range  of  .Bayesian  operations  can  bo  op- 


plied  on  probabilities  for  the  background  frame.  S.  This  is  a  departure  from 
the  position,  that  only  Dempster's  rule  is  appropriate  for  comb  lning  e  vide  tic  e 
ip  the  belief  function  context. 

rJ«±  have  :lo-w  noted  three  different  ways  in  which  an  expert  system  application 
nf  ghafar's  syitein  might  need  to  be  aupple^ented: 


»  fetal lb ration  q£  *0urtE5  of  evident*  In  totals  of  the  tont*IiC  *£ 
tht  evidence, 

*  refraining  evidence  and  hypotheses  to  achieve  indepnndence  of 
arguments , end 

*  reasoning  about  dependent  evidence  within  an  argument. 

Vc-  may  refer  to  this  set  of  issues  as  the  in coapl c toness  of  Dempster's  rule,, 
in  analogy  to  the  Incaap le t*i>U *  of  Bayesian  theory  dt*C vised  above, 

Plausibility  of  InS Carre es:  Conflict  of  evidence.  To  what  extent  does  belief 
function  theory  yield  inferences  which  are  intuitive  and  plausible  in  specific 
applications?  A  topic  of  special  concern  in  this  regard  is  conflict  of 
evidence.  Zadeh  (1984)  recently  raised  an  exasrple  of  the  following  sort. 
Suppose  we  havp  two  experts  who  wc  believe  to  be  very  reliable  and  who  produce 
Conflicting  j udgjMittu ,  For  Example.  there  are  thre*  possible  interpretations 
of  an  object  X  in  *  Specified  location:  is  an  SA-4  installation;  l^'^x 

is  an  5A-?  installation;  H^--X  Is  not  a  threat.  Analyst  A,  using  photographic 
evidence,  assigns  .99  support  to  11^  and  .01  to  Hjf  analyst  B.  using  indepen¬ 
dent  intelligence  information  assigns  .99  support  to  H-  and  .01  to  Hj.  We 
have  the  following  two  support  functions,  and  may  combine  them  by  DempatEr's 
rule,  aa  shown  in  Figure  2-4; 


Table  2-2 


n,E1'  ^ 

“AB<J> 

«1 

0.99 

0 

0 

% 

0.01 

0.01 

1,00 

h3 

0 

0,99 

0 
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The  counter intuitive  result,  according  to  Zadeh,  is  that  inclusive  support  Is 
cl  Du  assigned  t*  Hj,  a  hypothesis  that  neither  expert  regarded  as  Likely. 
Moreover ,  the  result  is  independent  of  the  probabilities  assigned  to  H.  or  H^r 

Shafer fs  response  (in  press)  Is  cogent,  but  ultimately,  we  feel ,  off  tha  mark. 
If  we  really  regard  these  experts  as  perfectly  reliable,  Shafer  says,  the  ar¬ 
gument  as  stated  la  correct,  After  all,  A  says  that  Is  impossible,  and  B 
rules  out  H|j  that  leaves  Hj  ns  the  only  remaining  possibility.  (It  is  impor- 
tant  to  note  that  exactly  the  same  result  would  be  obtained  in  Bayesian 
updating,  if  we  interpret  the  ra(")  as  likelihoods  -of  the  evidence  given  the 
hypothesis  and  assume  that  prior  probabilities  for  the  three  hypotheses  are 
equal,)  On  the  other  hand,  Shafer  argues  that  experts  are  seldom  in  fact  per¬ 
fectly  reliable.  A  more  reasonable  procedure  would  be  to  "discount*  the 
belief  functions  supplied  by  the  experts  to  reflect  our  degree  of  doubt  In  the 
reliability  o£  their  report a-  In  discounting,  we  reduce  each  degree  of  sup¬ 
port  by  a  fixed  percentage,  and  allocate  the  remainder  to  the  universal  set 
E  H  j , Hj  j  > ,  The  re  sul t  of  apply Ing  Demp  s  tet f  s  rul e  will  now  be  a  bel ief  func - 
tion  that  assigns  support  to  all  three  hypotheses. 

Let  us  exaains  this  response  in  a  bit  more  detail.  Recalling  that  we  regard 
these  experts  as  highly  reliable  (though  not  perfect),  suppose  we  discount  A's 
belief  function  by  ll  and  B's  by  2%.  The  result  is  the  following,  es  depicted 
in  Figure  2-5: 


Table  2*3 


nA 

? 

1 

»1 

0,0801 

0 

.6S6 

h2 

0.0099 

0.0096 

,013 

h3 

0 

0.9702 

,  )Z5 

0.01 

O.02 

.  D07 

Ue  now  have  a  "bim&dal"  belief  function,  with  the  preponderance  of  support 
going  to  and  H-j.  Thii  appears,  at  first  look,  to  be  an  intuitively 
plausible  result:  it  reflects  our  foaling,  which  we  represented  in  the  form 


Figure  Support  Functions  CP  Illustrate  Combination  of 

Ccmf  lit  ting  Evidence  with  Discounting 
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of  discount  rstcs ,  thnt  A  or  B  <ot  both)  could  possibly  be  unreliable.  But 
lot  uS  lock  A  little  more  closely , 

The  first  thing  to  note  is  what  a  vast  difference  a  snail  amount  of  discount¬ 
ing  makes.  In  Table  2-1,  after  combination  by  Dempster's  rule,  there  was  cm  - 
desire  support  for  .  In  Tab! a  2-1,  final  support  for  Hj,  is  only  slightly 
greater  than  It.  The  second  thing  to  notice  is  the  large  discrepancy  between 
,^Hi)  and  Although  we  did  in  fact  discount  B  at  twice  the  rate  as 

A,  the  actual  numbers  (2%  and  It,  respectively)  and  the  difference  between 
them  was  very  small.  It  is  by  no  means  clear  that  the  resulting  difference  in 
support  for  and  is  intuitively  plausible,  Jlore  to  the  point  +  the  sen¬ 
sitivity  of  the  result  for  all  three  hypotheses  to  very  small  differences  in 
discount  rat-es  is  disturbing.  Finally,  to  dramatize  the  sensitivity  even 
further,  note  that  if  support  for  .Hj  jH-j}  were  0  for  both  experts,  and  if  A 
assigned  0  support  to  and  B  assigned  0  support  to  these  very  small 

changes  tender  Dcopster's  rule  Indeterminate , 

Perhaps  the  problem  is  that  our  original  assessment  of  the  reliability  of  the 
experts  was  mistaken.  Suppose  then  we  discount  A  by  29%  and  B  by  10% .  Ve  now 
gflCJ 
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Support  for  Hj  and  Ho  after  combination  is  now  roughly  equal,  certainly  a  more 
intuitive  result.  Then  should  we  have  discounted  A  and  3  more  in  the  first 
place?  According  to  Shafer,  presumably,  this  is  indeed  the  caae;  the  fault  is 
not  in  the  theory,  hut  in  the  initial  allocation  of  support.  The  exaaple, 
however,  highlights  a  damper  problem.  As  wc  noted  above,  reliability  is  to  he 
assessed  as  if  we  had  no  knowledge  of  the  evidence  actually  provided.  Thus, 


we  are  Apparently  net  permitted  to  use  the  conflict  between  A  end  B  «  clue 
regarding  their  capabilities  or  as  a  guide  to  the  appropriate  amount  of 
di sc ounting ,  tfe  return  to  this  issue  very  shortly, 

Zadeh  himself  objects  to  the  procedure  in  Dempster's  rule  of  normal i z i n£  sup¬ 
port  measures  to  eliminate  impossible  combi nations „  But  ve  think  this  oh J op¬ 
tion  is  mistaken,  Formalization  is  In  fact  the  only  way  in  Shafer's  theory 
(albeit  quite  indirect)  that  our  knowledge  of  the  evidence  enters  into  the 
assessment  of  reliability.  It  accomplishes  a  sort  of  de  facto  discounting  as 
a  function  of  conflict  of  evidence.  Note  in  the  earlier  example  of  Figure  2-3 
that  the  reliability  of  witness  1,  after  combining  his  testimony  with  the  con¬ 
flicting  evidence  of  witness  2,  is  ' /(1-T^F^' } ,  This  it  less  than  the 

original  assessment  of  witness  1 ’ s  reliability. 

Although  normalisation  is  in  itself  not  problematic,  nevertheless,  it  Is  not  A 
complete  or  adequate  solution  to  the  problem  of  conflict.  First,  because 
there  is  no  lasting  effect  on  later  problems,  l.e.,  we  have  not  truly  updated 
our  estimate,  P-^*  of  A’s  reliability  in  the  light  of  his  conflict  with  3, 
Second,  there  ie  no  procedure  for  exploring  potential  reasons  for  the 
conflict,  A  clone f  examination  of  (a)  the  factors  that  determined  our 
original  reliability  estimates,  (b)  our  assumptions  regarding  independence  of 
the  two  arguments,  and  (c)  the  internal  structure  of  the  arguments  employed  by 
A  and  S,  might  lead  to  a  revision  in  beliefs  and  assumptions  that  permanently 
improves  our  knowledge  base. 

Ve  argue,  then,  that  the  revision  of  reliability  estimates  is  only  one  pos¬ 
sible  result  of  an  iterative,,  constructive  process  of  problem  solving  prompted 
by  conflict  of  evidence,  (Ve  also  have  the  options  of  re framing  evidence  and 
hypotheses  to  reflect  revised  judgjaents  of  independence  and  of  revising 
specific,  beliefs  internal  to  the  conflicting  arguments,  therefor*,  such  revi¬ 
sions  must  be  justified  by  tons t derations  which,  once  discovered,  carry  weight 
independent  *f  the  conflict  of  evident*  that  led  to  their  discovery.  Ideally, 
thes*  newly  discovered  factors  could  be  regarded  as  sufficient  to  justify 
revisions  in  reliability  estimates  independently  of  and  E^,  (Referring  to 
these  factors  a-S  F,  w®  would  have  Ft (R^ [ E^f^F)  “  This  justifies 

the  reasseeBiDnnt  of  reliabilities  in  the  light  of  the  evidence  in  the  Shafer- 
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Dempster  system,  and  is  the  method  used  In  the  inference  framework  to  be 
described  in  Section  3. 

ffhat  is  "conflict  of  evidence"  7  So  far*  we  have  taken  for  Erinted  the  notion 
of  conflicting  evidence,  and  that  In  eoelo  cases  at  leant  special  steps  are 
Justified  In  dealing  with  it.  But  It  la  by  no  naans  obvious  what  "conflict” 

Is,  or  why  steps  outside  the  normal  calculus  of  uncertainty  should  be  required 
to  handle  it.  Conflict  of  evidence  does  not  appear,  on  the  surface,  to  be  the 
same  as  Incoherence.  The  formal  constraints  of  Bayesian  theory  dictate,  as  we 
saw  above,  that  multiple  probabilistic  analyses  should  agree  with  one  another 
and  with  direct  Judgment,  Similar  coherence  constraints  can  be  derived  for 
Shafer's  theory  from  the  requirement  that  uncertainty  on  S  be  measured  by  a 
probability.  But  It  is  implicit  that  these  analyses  ate,  or  should  be,  based 
on  the  smrne  evidence,  There  appears  to  be  no  Corresponding  guarantee  of 
prescription  that  argiUBthts  based  On  different  evidence  should  arrive  at  the 
sssine  nr  similar  conclusions,  Dcspseer1, t  rule  is  designed  explicitly  to  com¬ 
bine  arguments  based  on  independent  evidence;  hence,  there  are  no  direct  con¬ 
straints  on  the  extent  to  which  tb&se  arguments  muse  agree  (except  that  there 
be  at  least  one  pair  of  meanings  from  the  two  arguments  whose  intersection 
twn- empty)  , 

Never thel*ssT  we  propose  that  the  resolution  of  conflict  in  a  belief  function 
analysis  be  construed  as  a  desire  for  coherence,.  The  missing  element,  which 
Is  responsible  for  the  incoherence,  is  a  judgment,  often  implicit,  regarding 
the  overall  structure  which  the  final  belief  representation  is  expected  to 
have,  Such  judgments  are  based  on  one's  knowledge  about  reasoning  in  a  par - 
ttcular  problem  domain.  "Conflicting  evidence1*  is  evidence  whose  combination 
produces  a  structure  that  violates  such  a  prior  expectation.  Tims,  the 
definition  of  "conf Lict"  win,  vary  from  one  problem  domain  to  another.  The 
locus  of  conflict  I*  net,  strictly  speaking,  bteween  the  two  sources  of 
evidence,  but  between  both  of  the**,  Otl  One  Side,  Surd  s  structural  expectation 
regarding  the  eutc*rtO  of  th*  argument,  on  the  Other.  Uhen  *  conflict  of  this 
soft  occurs,  in  ati  Iterative,  constructive  context,  the  decision  Raker  has  a 
choice  of  either  revising  the  expectation  or  else  making  one  ot  mote  of  the 
three  kinds  of  changes  we  discussed  above  (revising  discount  rates,  frames,  or 
stops  In  an  argument) , 
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If  belief  function*  AC*  probabilistic  with  A Lscountirtg,  fi.fc,,  assign  iuppOCC 
only  to  single  hfp*tih«*4j  and  to  the  universal  set),  Chen  it  ii  often 
plausible  to  require  that  hypOttleiei  which,  receive  Vt fy  little  support  from 
either  of  two  a E gyme n t s  not  receive  predominant  support  in  the  combined 
analysis.  This  was  the  basis  of  the  adjustment  of  discount  fates  in  the  above 
example  (and  also  seems  to  underlie  the  use  of  discounting  in  Shafer,  1982} . 
Note  that  an  analogous  requirement  la  recommended  for  Bayesian  analysis  by 
DeGroot  (19 £2), 

Other  possible  structural  expectations  regarding  the  form  of  a  belief  function 
.Lodel  include  that  it  be  consonant  or  hierarchical ,  In  these  cases,  support 
Is  assigned  only  to  nested  subsets  of  hypotheses  or  to  subsets  that  form  a 
tree,  respectively.  Neither  of  these  properties  Is  necessarily  preserved 
through  combination  by  Dempster r a  rule.  VetT  as  we  noted  above,  such  struc¬ 
tural  constraints  may  (a.)  be  quite  plausible  for  particular  problem  domains 
(c£,  t  Gordon  and  Shortll£feh  1984  h  on  medical  diagnosis) t  and  (b)  he  required 
to  improve  the  computational  traceability  of  a  Dempster -Shafer  model.  Thus, 
once  again,  a  higher -order  process  of  qualitative  reasoning  may  be  necessary 
to  -explore  revisions  in  beliefs  and  assumptions,  in  order  to  handle  *  conflict” 
and  to  ensure  the  applicability  and  plausibility  of  a  Dempster -Shafer  calculus 
(see  Section  3  below), 

An  Important  by-product  of  requiring  consonance  should  be  noted.  One  poten¬ 
tial  criticism  of  Shafer's  theory  is  that  it  lacks  a  concept  of  the  acceptance 
of  a  hypothesis  once  it  achieves  a  sufficient  degree  of  evidential  support 
(a.g.j  Levi,  1983 ■  L.J-  Cohen,  1977),  A  precondition  of  acceptance- -and  what 
makes  it  a  useful  concept  in  some  contexts --la  that  it  should  yield  a  logi¬ 
cally  consistent  and  complete  story,  Neither  is  true  if  s  threshold  or  cutoff 
for  acceptance  is  defined  on  Bel(L)  in  Shaferf  3  system,  Roth  a  hypothesis  and 
iti  complement  could  have  positive  support.  And  thus  conceivably  both  could  be 
accepted,  yielding  a  contradiction,  Nor  eo  vet  „  two  propositions,  p  Slid  q, 
night  be  accepted  but  their  Conjunction,  p&q ,  rejected..  .Both  of  these 
problems  disappear  in  a  cor.scr.ant  belief  function:  Since  a  hypothesis  and  its 
complement  are  not  nested,  they  cannot  both  receive  support;  and  it  can  he 
shown  that  Bel(ptq)  —  KTN(Bel(p)  ,B.el(q)}  and  thus  that  a  conjunction  ia  at 
least  a*  credible  os  either  of  it*  conjunct*. 
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In  All  these  CAiej,  there  is  A  tension  between  Che  dealt  Ability  or 
plausibility  of  depicting  the  state  of  evidence  “aa  It  Is,*  conflicts  and  all, 
end  attempting  to  produce  a  resolution  or  reconciliation  within  the  framework 
of  jdizc  plausible  or  desirable  global  requirement,  We  claim  that  thia  tension 
Is  at  the  heart  of  *ny  truly  Intelligent  and  flexible  reasoning  with  probabil¬ 
istic  systems. 

Summary.  Shafer's  theory  provides  A  natural  representation  of  quality  of 
evidence  and  relaxes  the  asses ^mertC  requirement  to  tb*  extent  that  the 
evidence  is  tnconp Le ts .  Like  Bayesian  theory,  however,  belief  function  models 
impose  inordinate  input  and  computational  demands  unless  specialized  models 
are  adopted.  The  validity  of  Shaforian  theory  has  not  been  clearly 
established,  although  It  may  be  illuminated  by  a  partial  Bayesian  derivation. 

A  major  difference  is  that  Shafer's  theory  decs  not  permit  te assessment  of  the 
quality  of  an  information  source  in  terms  of  what  that  source  says  5  the 
credibility  of  one  witness  cannot  be  increased  by  corroboration  of  a  second 
Witness  or  decreased  by  contradiction.  In  belief  function  theory,  the  outcome 
of  combining,  the  information  from  two  conflicting  data  sources  can  vaty 
dramatically „  depending  on  Cut  assessment  d£  chair  credibility.  Yet  we  Cannot 
u*e  the  two  sources  to  crosscheck  one  Another.  Ue  Argun  that  this  gap  in 
Shafer's  theory  requires  that  it  be  supplemented  by  a  process  of  qualitative 
reasoning  that  reexafflifte*  sources  of  evidence  as  an  analysis  proceed*,  artd 
recalibrates  them  in  the  light  *f  corroboration  conflict.  "The  process 

might  supplement  Shafer's  theory  in  other  ways;  by  refrsming  evidence  and 
hypotheses  to  establish  independence  of  evidential  arguments,  and  by  revising 
inferential  steps  which  are  internal  to  such  arguments, 

2.2,3  Fuszy  setf_  t^eo^y  ■  Waters  of  tbs  theory,  Since  L.A,  Zadeh  advanced 
fuzzy  set  theory  in  1965,  an  enormous  amount  of  Interest,  and  a  very  large 
literature,  has  been  generated.  Host  of  this  interest  has  been  theoretical, 
concerned  with  the  mathematical  implications  of  the  theory,  but  there  have 
been  a  number  of  attempts  to  apply  the  theory  to  practical  problems.  This  is 
in  line  with  Zadeh' s  original  reason  for  introducing  the  concept.  He  argued 
that  much  systems  analysis  was  inadequate  because  Its  requirements  were  too 
precise.  He  felt  that  our  intuitive  understanding  of  concepts  and.  more 
interestingly,  our  reasoning  about  those  concepts,  were  typically  imprecise, 
yet  analysis  (especially  with  computers)  required  prod  sificat  ion.  To  resolve 


4b 


this  paradoK,  tat  introduced  che  now  well-known  concept  of  rtw  fumy  t*t 

with  lTBpr*etifi  boundaries,  The  essential  element  la  the  membership  futicti&n 
p.A(x)  *?hlch  represents  the  degree  to  which  *n  element  s  helnngs.  to  torts  act  h . 

If  uA(x)  “■  *  fhfcfl  K  belongs  to  A,  while  If  UA(x)  K  ^oes  not 

belong  to  A,  An  Intermediate  Value,  such  as  D^U)  -  OJ,  Indicates  that  t 
belongs  to  the  set  to  some  degree.  Fuzzy  sets  ate  thus  a  precise  tool  for 
representing  and  Manipulating  imprecise  notions. 

Application  of  fu£zy  set  theory  involves?  first,  the  representation  of  In' 
precise  concept  by  fuzzy  sets;  second!,  the  use  of  a  calculus  to  construct 
other  fuzzy  sets  top res outing  the  output  variables  in  an  analysis;  and  third „ 
reinterpretation  ot  the  results  in  Imprecise  language  (see  L.A.  Zadab,  iy?bj_ 
The  first  and  last  Steps  sre-  crucial  if  the  flavor  o£  the  fuzzy  theory  Is  to 
be  fully  captured.  The  core  idea  is  to  construct  a  calculus  for  the  formal 
(!.«.,  precise  manipulation  of  Imprecise  concepts ,  which  takes  In  imprecise 
Inputs  and  puts  out  Imprecise  outputs. 

Applications  of  fussy  set  theory  to  Inference,  The  theory  of  fuzzy  seta  can 
be  applied  In  many  ways,.  In  the  sense  that  wherever  a  mathematical  relation¬ 
ship  exists r  it  can  be  fussified,  Thus,  there  are  many  possibilities  for 
using,  the  fussy  calculus  in  conjunction  with  other  inference  theories. 
Alternatively „  It  can  bo  applied  directly  to  ordinary  imprecise  reasoning  (by 
exports  or  non-expertsl  In  natural  language.  'We  will  Introduce  some  of  the 
formation  of  fussy  set  theory  by  examples  of  these  two  types. 

Fuzzy  Logic.  In  fuzsy  set  theory,  the  statement, 

"The  Installation  is  large," 

could  he  represented  as  a  fussy  membership  Vj  (i),  which  measures  the  degree  of 
aerobe rship  of  the  installation  i  in.  the  sot  of  "large"  installations  (where  U 
represents  non- roeabe rship  and  1  denotes  complete  membership) r  The  degree  to 
which  an  installation  is  both  large  atid  modern  Is  the  teinlmua  of  th*  two  mem¬ 
bership  functional 
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Implication  in  fuzzy  set  theory  is  defined  as  a  relation.  Thus,  "if  D  la  F, 
than  V  la  G/  where  F  and  G  are  fuzzy  sets  on  the  variable  a  u  and  v  underlying 
If  and  V,  i*  described  by  the  relation 

^V/U^v)  -  -ain£lth2<v)  +  1-  Uj^u)) 

using  an  obvious  notation.  This  may  be  interpreted  as  the  extent  to  which  a 
particular  value  of  H  implies  a  particular  value  of  V. 

The  next  step  is  to  combine  the  rule  with  a  statement  about  the  fact  described 
In  its  antecedent.  In  fuzzy  Implication,  not  only  may  be  the  concepts  in* 
volved  he  fuzzy,  but  the  cestch  between  a  fact  and  the  antecedent  of  a  rule  may 
be  a  [tatter  of  degree  as  mil.  Thus,  may  have  a  rule  stating  'If  V  is  f 
then  V  is  G,"  hut  an  input  stating,  fcha-t  "U  is  F1* " .  whore  F  and  F*  dr*  not  the 
sarm,  Zadnh  defines  this  as 

Wy(v)  -  IMPL(nln(  11^(11),  Vvyy^v))). 

u 

where  Y  1*  the.  fuzzy  set  that  results  from  combining,  F*  and  Y/U. 

HCVlng  befit  to  our  example,  suppose  u*  have  a  rule, 

MIf  an  I  natal  Inti on  is  modern,  then  the  danger  is  high.™ 

We  Could  express  this  Fult  as 

yi/D{i,d>  -  *in(l,  uH{d>  +  1  -  Vl». 

tha  ew tent  to  which  modernity  of  *n  ins ta) 1 at inn  implies  high  dinger  of  the 
Installation,  Mow,  suppose  we  h*ue  another  £ul*y  tmteihe  r  *  M  p  futmtioft  R(i) 
representing,,  perhaps,  the  input ,  "the  installation  Wat  built  recently,"  Tht 
result  is 

PyCi>  “  DwUhlintUg^l),  UI/D(Iht>))) 

-  maxfmin'Uigiil ,  min(l  .Uy^?  +  l  -  ^(1)))}, 
i 


This  output  t*fi  be  interpreted  as  *  queptit^tiv*  moatur*  chat  the  danger  is 
high,  glvtn  th*  fuzzy  evidence  roB»rding  modernity  and  the  fuzzy  iaiplitati&A 
rule,  Th*  Hiutput  aty  now  ha  train*!  a  tad  into  an  imprecise  natural  rang*  rtpro- 
scrtatjor  (4.^.  ,  "danger  is  'quit*  pO££lbly  high11). 

Fuzzy  probabiLitl&f ,  Uncertainty  about  facts  (!.«.»  chance)  vq&  net  mentioned 
above;  wp  just  talked  about  imprecision,  Zadeh  stresses  that  the  two  -concepts 
ere  distinct,  and  that  fuzzy  set  theory  should  only  be  used  to  describe 
Imprecision,  If  W*  are  imprecise  our  uncertainties,  however,  then  a  idle  «x- 
lsts  for  describing  that  Imprecision  With  fuzzy  s«ts,  Watson  et  al„  (19?9) 
and  Zadeh  (1991)  discuss  this  idea  in  the  context  of  decision  analysis d  but  it 
car.  clearly  be  applied  to  any  use  of  Bayesian  probability  theory,  or  belief 
function  theory. 

The  basic  tool  for  fuZZlfying  a  calculus  is  Zadeh's  extension  principle,  which 
enables  us  to  compute  the  fuzzy  set  membership  function  for  a  variable  when  it 
is  a  function  of  Variables  whose  fuzzy  sat  membership  functions  are  known. 

Let  Y  -  .  ,1^)  .  Then  P^Y)  -  ms3c|min(U  (x2>  , . , ,  h  V^Cfcg)) 

where  y(y)  *s  th*  extent  to  which  a  value  y  belongs  to  the  set  of  possible 
numbers  for  the  output  variable. 

Suppose  a  threat  classification  procedure  leads  to  a  probability  p  that  a 
threat  should  be  classified  as  an  SA-4.  Imagine  we  have  a  loss  function  which, 
gives  unit  loss  if  misclassif ication  occurs,  and  zero  less  If  not.  Then  the 
expected  loss  from  classifying  the  object  as  an  SA-4  is 

1  it  (1-p)  +  0  X  p  -  1-p 

while  the  eKpCctod  los*  from  classifying  the  object  ea  HTiot  an  is 

1  x  p  +  0  X  (1-p)  -  p. 

Clearly,  we  minimize  expected  loss  by  categorizing  it  as  an.  5  A- 4  if  p>l/Z, 

Mew  suppose  that  we  are  imprecise  about  p  to  the  extent  that  we  can  only 
describe  a  fuzzy  set  (p )  about  possible  values  of  p.  Fuzzy  sets  for  the  ex¬ 
pected  loss  in  the  two  cases  (actually  U(l-p)  and  can  be  produced  using 

Zadehrs  extension  principle.  But  what  conclusions  can  we  draw?  Free ling 
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(I960}  discusses,  this  in  sense  detail,  suggesting  several  alternative 
approaches.  As  we  night  expect,  when  results  are  fuzzy,  the  analysis  may  not 
indicate  any  particular  decision  regarding  class if lea cion. 

As  with  the  Bayesian  analysis,  there  are  sene  non- trivial  problems  in  attempt¬ 
ing  to  apply  fuzzy  set  theory  to  inference  in  expert  systems, 

Feasibility.  Ue  criticized  both  Bayesian  theory  and  belief  function  theory  op 
the  grounds  that  the  analysis  involved  in  practical  problems  can  he  quite 
complex.  This  will  also  be  true  of  fuzzy  set  theory.  The  fact  that  functions 
of  variables  have  to  be  handled  in  computations  makes  the  analysis  difficult 
to  handle  numerically.  Nonetheless,  there  are  indications  that  the  max -min 
operations  are  numerically  easier  than  the  sum -product  operationa  of  the  other 
theories.  It  would  he  wrong,  however,  to  assert  that  the  use  of  fuzzy  set 
theory  remove g  all  of  the  difficulties  caused  by  coop laxity  in  the  other  two 
theories  examined  here, 

Validity,  F'or  a  theory  which  has  had  an  enormous  literature,  there  is  still  a 
considerable  discussion  amongst  scholars  cm  the  Justification  and  interpreta¬ 
tion  of  ths  theory. 

Semantics:  Wfaetp  flo  t^s  jpunibers  come  ffropi.T  This  question  is  raised  by  most 
people  when  they  first  study  fuzay  set  theory.  There  are  no  standard  proce^ 
dures  to  be  applied  in  every  case;  anything  plausible  would  seem  to  do.  In 
particular <  there  are  neither  behavioral  specifications  nor  canonical  examples 
of  the  kind  Shafer  claims  to  be  important.  Zadeh  would  argue  that  a  theory  of 
imprecision  should  not  need  precise  inputs,  so  that  we  should  not  bother  too 
much  over  the  exact  nature  of  the  input  membership  functions.  If  that  is  the 
case,  then  answers  should  not  be  very  sensitive  to  input  membership  functions, 
In  many  applications,  this  is  not  the  case,  and  indeed,  sometimes  answers  are 
sensitive  to  just  one  point  on  a  membership  function. 

tfhat.  is  ihc  Tne-ining  oi  the  output?  Paralleling  the  uncertainty  relationship 
between  human  perceptions  of  Imprecision  And  the  calculus  of  fuzzy  sets  is  the 
reverse  relationship:  once  we  have  computed  an  output  fuzzy  set,  what  do  we 
do  with  it?  We  briefly  discussed  the  possibility  of  linguistic  interpretation 
above.  This  does  not  appear  to  have  been  a  satisfactorily  implemented 
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approach,  although  In  part  because  people  -differ  In  the  conclusions  they  draw 
from  tbs  Sana  natural  language  statement  L 

In  the  light  of  these  difficulties ,  it  is  not  surprising  that  efforts  should 
be  made  to  assimilate  fuzzy  sets  to  soac  other  framework  of  uncertainty,  such 
as  the  Bayesian  or  Shaferlan.  It  is  difficult  to  do  this  In  a  natural  way. 
however j  doe  to  the  difference  between  Imprecision  and  uncertainty  about 
facts.  For  example,  suppose  Analyst  A  refers  t*  an  object  x  as  "long',  after 
having  measured  X  exactly.  There  is  no  doubt  aa  to  xhs  actual  length  and  al¬ 
though  A  esay  regard  x  as  long  only  to  a  certain  degree,  ho  Is  not  uncertain 
whether  or  not  x  la  long,  Uhat  fact  then  could  A  he  uncertain  ofT  tfc  add 
three  caveats;  (i)  If  A  tells  a  second  Analyst  B  that  X  is  long,  then  S  may 
be  uncertain  regarding  x'a  actual  length;  (II)  If  A  had  only  glanced  ar  X, 
rather  than  measuring  it,  he  might  be  uncertain  (as  uull  as  imprecise)  about 
x's  actual  length;  (ill)  we  may  in  fact  he  uncertain  as  to  whether  a  random 
English  speaker  would  call  the  object  ‘'long'"*  Nevertheless*  the  etoet  natural 
approach  is  to  treat  this  kind  of  uncertainty  as  the  degree  tc  which  x  (or  an 
object  of  x"b  length!  is  long,  rather  than  the  chance  that  x  is  long.  Fut 
another  way,  those  degrees  are  part  of  the  meaning  (denotation)  of  “long" ,  and 
not  (necessarily)  a  result  of  uncertainty  about  what  "long1"  means  or  about  the 
actual  length,  of  an  Object. 

Nonetheless,  it  may  be  worthwhile  exploring  ways  to  repreeent  imprecision  in 
terms  of  Other  frameworks.  For  example,  a  consonant  Shafer  fan  support  func¬ 
tion  obeys  a  calculus  that  closely  approximates  Zadeh’s  possibility  theory. 
■Consonant  support  functions  seen  appropriate  for  representing  imprecision  in 
the  implications  of  avidence  tit  points  tc  a  set  of  nested  regions  where  the 
truth,  could  lie) .  And  they  have  the  advantage  of  a  somewhat  more  secure  nor¬ 
mative  foundation.  Thus,  the  possibility  of  translating  between  natural  lan¬ 
guage  expressions  end  support  functions  might  be  worth  exploring,  despite  sene 
coat  in  naturalness. 

Inference:  tfhst_are_the  appropriate,  connectives?  In  terns  of  either 
axiomatic  justification  or  face  validity,  the  procedures  Zadeh  recoimends  for 
combining  his  nucha r ship  functions  are  not  unique.  For  example,,  Zadeh  argues 
that  the  degree  tc  which  an  element  belongs  to  a  set  A^  and  another  set  A-j 
should  be  computed  by 


{*)  "  aln(UA  (X)  (x)) 

1  2 

This  1b  clearly  consistent  with  the  te-qul lament  that  If  both  Sets  ate  crisp 
(l.o. j  only  takes  the  values  0  of  1) „  set  membership  should  obey  the  usual 
rules  (l.e,  h  it  Aj  A2  If  and  only  If  x  and  K  -  Note  however*  that  this 
Is  not  the  only  connective  rule  with  this  property.  For  e Kerr.pl 0,  the  family 
of  connectives 

1-fc  1-flt 

■in^4i<*)%s,(*)t  0<a<l. 

all  have  this  property *  where  1-ti  is  a  power  to  which  the  membership  function 
is  raised.  Zadeh  chooses  a. -  1;  the  choice  offa  —  0  gives  the  Bayesian  rule  for 
the  probability  of  fl  conjunction  <nu»ly  (x)Uj^(i)),  There  are  nany  other 
possible  definitions  {set  Dubois  and  Prado*  19£d) . 

Similarly,.  d  1* j cue t loft *  negation  and  implication  all  have  alternative 
representations „  and  the  chnit*  Of  the  forms  usually  employed  is  arpisble.  So 
far  AS  we  ere  euAtn;h  very  little  research  has  been  o err led  out  mi  the  irapli ca¬ 
tion*  of  using  different  connectives  cn  the  itiulCi  uC  a  fwtry  analysis. 

There  is,  therefore,  seme  art i tear lues a  in  the  Connect iveH  chosen  by  Zodeh’-en 
arbitrariness  which  pervades  the  theory, 

Plausibility  of  instances:  The  main  strength  of  Zadeh's  theory  is  in  its 
ability  to  produce  Instances  cf  reasoning  that  arc  acceptable  on  a  ease  by 
case  basis.  In  this  regard,  it  has  a  richness  and  scope  that  no  Other  theory 
oven  at  tempt  a  to  cap  Cura,  In  particular,,  it  is  the  only  theory  that  attempts 
to  formalise  the  combination  of  considerations  based  or.  similarity  (e.g,,  the 
closeness  of  F*  to  F  in  tho  above  example  j  with  more  traditional  considera¬ 
tions  In  Inference  (e.g.,  traditional  logic  or  probability).  In  this  largely 
uncharted  domain ,  the  (present)  absence  of  deep  normative  foundations  may  be 
no  di a grace. 

Nonetheless,  there  may  be  cases  where  fuzzy  logic  gives  implausible  (or  non- 
Liseful)  answers.  Fuzziness  is  concerned  with  what  is  possible,  rather  than 
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what  Is  probable,  Zed  eh  sees  a  possibility  distribution  as  being;  an  upper 
bound  on  a  probability  distribution.  Articulating  the  possible  may  be 
important,  but  if  many  options  are  possible,  it  does  not  help  in  our  search 
for  what  is  probable,  In  practice,  this  point  lj  expressed  by  the  tendency 
for  fuzsy  sets  to  produce  rather  bland  answers,  giving  high  values  of  the  ®tea- 
bershlp  function  for  large  seta  of  variables,  fine  can  see  some  applications 
when  this  is  not  an  obstacle  to  understanding,  if  soffit  important  options  are 
seen  to  have  very  loir  or  zero  possibility.  In  general.  It  does  present  a 
difficulty. 

SWrnnsry r  Fussiy  logic  la  a  highly  flexible  and  versatile  tool  for  handling 
imprecision,  it  may  be  applied  directly  to  reasoning  with  verbal  expressions 
or 3  ac  a  higher  level,  to  reasoning  with  a  numerleal  C Siculus  like  probability 
theory,  Unfortunately,  the  ne^ning  of  fuisy  measures  Is  not  always  clear j  and 
the  rules  for  manipulating  the*  teem  tc  leek  Any  deeper  Justification  than  the 
plausibility  of  the  answer  in  A  specific  Application. 

2 . 3  Qualitative  Theories 

£,3,1  Classical  loatc.  Only  a  brief  mention  will  be  given  here  of  classical 
Ingle,  Its  relevance  is  as  the  traditional  paradigm  of  analytical  reasoning, 
dating  back  to  the  time  of  Aristotle  And  achieving  maturity  in  twentieth  cen¬ 
tury  mathematical  logic  associated  with  such  tiaras  as  Bus  sell  ,  Codclr  Church, 
and  Tarski r  As  such,  it  provides  a  point  of  comparison  for  other  theories, 

Cla.se.ical  logic  is  built  upon  e  fit™  axiomatic  foundation  of  principles  for 
reasoning  from  a  set  of  premises  to  a  conclusion.  Straightforward  procedures 
exist  for  checking  the  validity  Of  an  argument,  A  number  of  features  of  clas¬ 
sical  logic,  however,  mAke  it  clearly  inadequate  as  the  sole  basis  for  an  ex> 
part  reasoning  system,  or  as  an  analytical  model  of  real-life  human  reasoning. 

•  Class leal  logic  moves  from  certain  premises  to  certain 
conclusions.  No  provision  la  made  for  reasoning  in  uncertain 
domains . 

•  Due  to  its  district  nature,  there  ts  difficulty  capping  messy 
real -world  problems  Into  the  crisp  input A  required  for  logical 
analysis, 

•  Logical  implication  it  very  different  fro*  causal  implication. 
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Classical  logic  i.s  not  equipped  to  deal  with,  causal  relationships 
among  variables. 


•  Classical  logic  is  n»ru?te>ni.c ,  l.e.  the  number  of  provable  state- 
ments  Increases  monotonically  with  the  number  of  premises,  In 
contrast f  human  teasoners  oft an  adopt  provisional  assumptions , 
deriving  conclusions  which  may  later  ba  retracted  when  new  infor¬ 
mation  invalidated  the  assumptions. 


In  Section  2 . 2  we  have  seen  examples  of  inference  frameworks  designed  to 
address  some  cf  these  shortcomings,  Jeffreys  (19391  developed  his  axiomatic 
function  for  Bayesian  inference  as  an  extension  of  classical  logic  to  truth 
values  intermediate  between  certainly -true  and  ceEtainly-fals* ,  Thci  various 
axiom,  systems  for  Bayesian  inference  ore  clearly  modeled  after  those  for  clas¬ 
sical  logic. 

Esdth's  fuszy  set  theory ,  is  wo  hove  seen,  was  developed  to  counter  the  second 
problem,  which  Is  shared  by  Bayesian  and  Shaferlsit  theories. 

The  third  problem  was  also  noted  id  our  discussion  of  Bayesian  theory. 

Shafer fs  theory  is  batter  equipped  to  deal  with  causal  lints  tfcati  Is  logic  or 
Bayesian  theory,  Specifically,  the  link  between  evidence  and  conclusion  in  an 
argument  on  which  a  belief  function  Is  based  may  be  s  causal  model  according 
to  which  the  evidence  causes  the  conclusion. 

The  next  section  describes  an  attempt  to  deal  with  Eh*  last  problem  by  fnr- 
isolating  a  reasoning  system  that  reasons  fret*  default  assumptions*  to  con¬ 
clusions  which  may  be  retracted  if  the  aa sumptions  on  which  they  are  based 
turn  out  to  be  false, 

2,3-2  Iv&n -mono to oj  c  reasoning-  ifsrujre  of  tbs  Theory,  Mon -mono tonic  logic 
has  its  roots  in  the  non -numeric  tradition  of  artificial  intelligence.  The 
first  application  of  the  ideas  of  nan- mono tonic  reasoning  was  by  Stallman  and 
Suasman  (1977}  ,  and  since  that  time  die  theory  has  generated  intense  interest 
in  the  artificial  intelligence  and  expert  systems  communities  (e.g.,  Doyle, 
1979;  McDermott  and  Doyle,  1980;  McDermott,  1981;  Reiter,  1930;  Moore,  1935), 

Hbn-monotonic  logic  was  developed  to  counter  ch*  failure  of  traditional  ap¬ 
proaches  to  capture  the  non -monotonicity  of  human  reasoning.  Specifically, 
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traditional  formal  axiomatic  logics  are  non-monotonlc,  in  that  the  number  of 
provable  statements  in  the  system  increases  none conic ally  in  time  as  new 
axioms  or  premises  are  added  to  the  system.  In  contrast,  In  a  non -mono tonic 
system  a  theorem,  may  be  retracted  when  new  information  (axioms')  are 
introduced. 

Human  reasoning  is  commonly  non - mo notonic „  In  the  face  of  fncompleea 
evidence,,  people  adopt  "default  assumptions,*  acting  as  if  they  are  true  until 
evidence  arises  to  the  contrary.  For  example,  we  wight  adopt  a  provisional 
assumption  that  there  in  no  E0*  in  the  area,  which  implies  that  our  localisa¬ 
tion  of  threats  is  reasonably  accurate.  If  we  late  If  discover  that  there  is 
evidence  of  Ecti,  we  drop  the  Initial  assumption  and  out  confidence  in  the 
threat  localisations  is  degraded,  Human  teas oners  are  sV 11 led  at  incorporat¬ 
ing  conflicting  data  into  existing  arguments  so  as  to  achieve  consistency  with 
minimal  disruption  of  the  established  system,  Hon- mono tonic  reasoning  systems 
attempt  to  model  this  process  of  revising  systems  of  belief  to  ncxoiwaodate 
conflicting  information. 

We  may  contrast  non-monotonlc  reasoning  with  systems  based  in  the  probability 
tradition,  which  employ  numerical  measures  of  uncertainty.  In  the  above 
example 3  a  Bayesian  *r  Shafer! an  system  would  assign  a  numerical  degree  of 
support  to  the  hypothesis  that  la  present.  Whan  further  information  Is 
received,  degrees  of  support  are  updated  to  incorporate  the  flow  information. 
These  systems  are  (wnotomlo  in  the  sente,  that  one*  a  conclusion  is  declared 
certain,  it  cannot  be  retracted.  Uncertainty  Is  expressed  by  assigning  de¬ 
grees  of  euppott  of  less  than  unity  to  each  of  the  uncertain  hypotheses. 
Bayesian  and  Shafer! an  theory  lack  a  mechanism  for  accepting  an  uncertain 
hypothesis  once  it  becomes  "certain  enough . "  Conflicting  evidence  is  regarded 
as  stochastic  (that  is  due  to  noise  in  the  data)  rather  than  as  evidence  of  an 
incorrect  me del;  this  leads  in  some  examples  to  counterintuitive  results 
(e,g,,  the  example  of  Figure  2-4),  It  has  been  argued  that  non-monotonlc 
masoning  captures  more  fully  the  feature e  of  human  reasoning,  because  of  its 
capacity  to  adopt  uncertain  hypotheses  as  provisional  assumptions,  acting  as 
tf  they  were  certain  and  deriving  conclusions  from  them,  while  retaining  the 
ability  to  drop  them  If  they  later  turn  out  to  be  implausible.  Never the 1 ass , 
noti-wonotonic  systems  suffer  from  the  inability  to  distinguish  degrees  of 
certainty.  The  ad  hoc  nature  of  their  mechanisms  for  belief  revision  (iee 
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discus t ion  below)  Is  in  large  part  attr ibucnblc  tn  Chit  Inability.  There  have 
tciin  suggestion*  (Ginsberg,  19BA;;  Cohen  *t,  el,,  L9B5)  cff  meeos  of  combining 
degree*  cf  belief  lute  fiofl-motfetetiic  systems,  but  ehu»  far  none  has  been 
Implemented  in  *n  expert  lyitra. 

Sfm^furt  o£  4  Non- Monoton  Ic  System;  Dependency  Directed  Backtracking ,  An 
important  feature  of  v  non- mono  Loni  c  ays- ten  Is  its  mechanism  for  revising 
beliefs  in  the  presence  of  new  evidence.  At  any  point  In  tine,  a  non¬ 
monotonic  system  has  a  Hot  of  currently  believed  statements f  together  with  a 
record  of  how  these  beliefs  were  derived.  As  long  as  new  information  is  con¬ 
sistent  with  current  beliefs,  the  system  incorporates  the  new  information,  by 
combining,  it  with  the  currently  believed-  statements  ,  using  its  inference  rules 
to  derive  new  beliefs.  At  some  time,  however t  new  information  may  lead  to  an 
Inference  that  contradicts  a  currently  held  belief.  When  this  happens,  the 
system  most  change  some  of  its  beliefs  so  as  to  achieve  consistency .  Because 
it  retains  a  record  of  the  proofs  of  each  of  the  contradictory  statements,  the 
system  need  only  re-examine  those  beliefs  actually  contributing,  to  the 
contra-diction.  Thus,,  the  system  traces  bach  through  the  proofs  to  find  those 
beliefs  upon  which  the  contradictory  inferences  depend,  and  makes  the  neces¬ 
sary  revisions  to  achieve  consistency.  This  process  has  been  labeled 
dependency - d Irec ted  beck tracking . 

Dependencies  in  a  non- mono tonic  system  are  represented  by  justifications  of 
statements  in  terms  of  cither  statements.  The  primary  form  of  justification  Is 
a  data  structure  called  a  support  list,  A  support  list  justification  for  a 
statement  has  the  form 

Statement  it  Statement  (SL  <inlist>  <eutlist>) , 

A  statement  is  believed  if  it  has  a  valid  justification,  a  Support  list  jus¬ 
tification  is  valid  if  every  statement  in  the  ini 1st  Is  believed  and  every 
statement  in  the  outlist  is  not  believed,  Ve-  may  distinguish  three  typos  of 
justification:  premises.,  mono tonic  justifications,,  and  non -monotoni c 
Justifications . 

A  premise  it  a  statement  with  empty  inlist  and  eutlist.  For  example: 


-  Sfr  - 


Agent  testifies  invasion  is  planned 


<SL  O  ()>- 


TSt-l 


This  statement  ia  automatically  regarded  a*  IN  <1, e,*,,.  believed)  end  ?™»l 
be  retracted r  fromfeo*  might  be  observational  data  or  unquestioned  general 
principle*.  As  new  observations  Accumulate,  nw  premises  may  be  added  Co  the 
systew , 

A  mono conic  Justification  has  a  non-eiapty  inlist  and  an  empty  eutltst.  foE 
example : 

N-£  Invasion  is  planned  <£L  (Agent  so  testifies.,  agent  is 

trustworthy)  O) . 

This  justification  says  that  the  statement  la  IN  If  all  items  in  the  inliat 
are  IS. 


Hon -mono tonic  justifications,  or  assumptions,  have  non-empty  outlists,  Far 
example : 

K-3  No  invasion  la  planned  (SL  (>  (Invasion  is  planned)-)' 

This  statement  says  that  N-3  is  LEI  unless  there  is  evidence  to  the  -contrary. 

Mow  1st  us  sco  how  a  non- mono tonic  system  might  handle  our  example,  Ve  start 
by  adding  an  additional  assumption 

SI-4  Agent  is  trustworthy  (SL  Q  (Agent  is  untrustworthy!  - 

Let  us  suppose  we  begin  with  nodes  K-2,  N-3  and  F-4  as  the  only  items  of  in¬ 
formation  in  the  system,  N-3  and  N-4  are  IN  (our  having,  no  evidence  to  the 
contrary)  and  K-2  is  OUT.  This  models  the  situation  before  we  received  the 
agent's  report,  Once  we  receive  the  agent's  report,,  we  add  the  premise  N-l. 
This  causes  H-2  to  move  IN. 


Wo  reasoned  above  chat  N-2  and  NO  war*  contradictory,  and  responded  by  drop- 
ping  the  assumption  CT-3.  To  mirilo  this  reasoning,  the  system  needs  to  know 
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that  those  nodes  are  incompatible! ,  Thus,  th*  ayaeeci  needs  to  iia.ve  another 
uodt 


[3-5  CamtADlCriOH  (SL  <tr-2 .  N-3)  O). 

When  IT -2  moves  ItT,  this  C*uses  the  CONTRADICTIOR  nod*  H-5  to  move  in  il». 

The  presence  of  a  DOWTRADl CTIGN  mode  among  the  currently  belief  statements 
triggers  the  process  of  dependency ■ directed  backtracking.  When  a  contradic¬ 
tion  is  encountered,,  the  system  searches  for  the  set  S  of  assumptions  respon¬ 
sible  fee  the  contradiction.  The  sot  S  will  contain  any  assumptions  In  the 
topper C  lists  any  nodes  involved  in  deriving  the  argument  leading  to  the 
contradict  ten.  In  this  case,  S  vill  contain  IT- 3  and  K-4,  Clearly,  if  JT-3  lb 
taken  OUT,  IT -5  Will  aOVo  CUT  and  the  Contradiction  will  be  resolved.  If  N-4 
Is  OUT,  then  N-2  naves  OOT  And  eg* in  the  contradiction  is  removed. 

The  syscem  new  seta  up  a  new  node  of  the  form 

Statement  ff  NGGOOD  £  (Cf (CONTRADICTION)  (&) 

where  CP  is  a  conditional -proof  justification.  This  CP- justification  is  Valid 
if  whenever  £  ie  valid,  the  COSTEAMCTION  Is  believed.  In  ocher  words.,  Che 
validity  of  the  Justif ication  depends  op  the  relation  between  the  premise  {S) 
to  the  cone lua ton  (COKTRAD1CTIOH) ,  irrespective  of  whether  the  premise  is  Cur¬ 
rently  believed.  In  our  example,  the  syst&fl  would  define 

K-$  UOSODP  f^3,  (CP(P-5>  (fl-3,  N-4)  ()) , 

This  Cp- justification  ia  valid  because  IT- S  Is  Ifl  whenever  B’3  and  H-4  arc  both 
TH,  This  node  says  that  H-3  and  N - 4  art,  taken  together,  "no  good," 

The  syste®  now  baa  to  decide  which  of  the  assumptions  in  S  is  to  be  dropped. 

A.  ''culprit'*'  C  Is  selected  from  among  those  nodes  In  S,  and  the  system  deetdos 
to  deny  that  as sumpt Lon .  Recall  that  to  deny  an  assumption,  the  system  must 
believe  some  member  of  the  outlist  of  the  assumption.  The  system  does  this  by 
setting  up  a  support  list  justification  for  some  member  0  of  the  outlist  of 
the  culprit.  The  inlist  of  this  justification  cental ns  all  the  aa sumptions  In 
S  except:  C„  together  with  the  NOGOOD  node.  The  outlist  contains  *11  the  node* 
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in  the  outllst  of  C  OxC&pt  0,  Thus,  the  Justification  says  that  if  you  vnpt 
to  believe  the  other  assumpt ions  in  &  (other  than  C)  and  if  you  do  not  believe 
any  other  node*  in  the  ovtliot  of  C,  then  you  should  believe  Q.  The  result  of 
this  justification  l*  that  a  ia  believed  (provisionally)  ,  sending:  c  OUT  and 
resolving  the  contradiction ,  of  oourso.  0  itself  mny  l*t*r  have  to  he 
retracted  as  a  result  of  another  contradiction,  which  would  lead  either  to 
belief  in  some  other  member  of  the  outlist  of  C  or  to  the  retraction  of  some 
assumption  other  than  C, 

Let  Us  return  to  our  example,  and  Suppose  that  N-3  is  selected  as  the  culprit. 
The  Outlist  of  W-S  has  only  one  ■ember.  S'-?.  A  now  justification  is  rh«n  set 
up  for  fi-2,  which  now  appears  as 

N-S"  Invasion  is  planned  (5-M Agent  SO  testifies,  agent  is 

trustworthy)  O) . 

<SL(U-b)0). 

Mote  that  if  N-3  had  other  nodes  in  its  outllst,  the  new  justification  wnuld 
have  a  non-empty  outlist,,  and  would  cease  to  be  valid  If  on*  of  tba  nodes  in 
its  outlist  came  IU. 

It  appears  that  B-21  can  now  be  justified  either  by  the  agent fs  testimony  or 
as  an  assumption  required  to  resolve  the  contradiction.  represented  by  S-G. 

But  the  second  justification  is  circular,  because  it  was  N-  2  that  gave  rise  to 
the  contradiction  in  the  fiTst  place,  Doyle's  Truth  Maintenance  System  guards 
against  such  circularity  by  designating  some  justifications  as  **ue  11  -  founded H 
and  others  as  not . 

feasibi Ii£y .  dependency  directed  backtracking  is  a  species  of  discrete 
relaxation  (like  'Uala  filtering,  as  described  in  Cohen  and  Fetgenbaum,  1932), 
It  seeks  a  consistent  allocation  of  truth  values  across  a  set  of  statements, 
by  utilising,  local  consistency  constraints  between  pairs  of  statements,  rather 
than  by  exhaustive  search  through  the  space  of  all  possibilities.  Thus,  a 
high  level  of  computational  efficiency  can  be  achieved. 

To  make  this  oEEfticney  possible,  however ,  in  non-monotonlc  systems,  the 
traces  of  proofs  are  retained,  even  though  the  premise*  utilized  by  the  proof. 
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and.  the  statement  that  was  proved,  may  ( temporarily >  be  judged  invalid  of  OUT. 
Therefore,  If  the  premises  become  valid  of  IN  at  some  later  time,  the  work  o£ 
rediscovering  the  proof  need  net  be  repeated.  The  Justifications  consume 
space  In  memory r  and  the  tradeoff  Is  therefore  made  between  memory  storage  and 
the  processing  overhead  of  regenerating  proofs  on  the  fly, 

Face  validity.  Implementations  of  flon-manotonic  reasoning  revise  beliefs  so 
as  to  arrive  at  a  consistent  overall  system  of  beliefs  in  the  face  of  a 
contradiction.  But  they  provide  only  a  very  limited  capability  for  deciding 
among  alternative  possible  revisions.  The  selection  of  an  assumption  as  the 
fl culprit^  and  the  ss lection  of  a  member  of  its  oj^llst  to  be  assumed  as  true, 
are  both  highly  arbitrary .  Some  control  information  is  imp licit  in  the  order¬ 
ing  of  nodes  in  the  ou^llst  of  statement  5  f  i,e..  ,  if  5  is  to  be  rejected,  the 
syetem  will  then  assume  the  truth  of  members  of  uunbers  in  the  list  in  the 
order  shown.  But  >(3)  this  ie  insufficient  to  remove  all  ambiguities,  and  (b) 
it  makes  control  information  implicit  rather  than  explicit,  hence  ,  difficult 
to  evaluate  or  modify, 

Flausibility  of  instances:  Conflicting  evidence.  An  often,  voiced  criticism 
of  non - mono tonic  reasoning  is  that  uncertainty  calculi  (e.g.,  Bayesian, 

Shafer ianf  or  fuzzy)  can  do  the  same  job  better, 

Althou^i  we  are  Convinced  of  the  value  of  numerical  representations  of 
uncertainty,  we  will  argue  that  there  is  an  important  role  of  non -mono tonic 
reasoning  (1)  in  drawing  implications  for  the  validity  of  one  argument  or  line 
of  reasoning  from  another,,  even  where  they  are  independent,  and  (2)  in  reason¬ 
ing  about  the  application  of  the  uncertainty  calculus  itself. 

The  basic  idee  of  Cl)  is  the  following:  Suppose  we  have  two  independent  line a 
of  reasoning,  A  and  Bh  with  regard  to  the  same  sets  of  hypotheses.  Each  line 
of  reasoning  depends  on  certain  data  and  certain  assumptions,  as  illustrated 
in  Figure  2  =-6.  In  Argument  A,  the  impact  of  Data  1  and  Data  2  depends  on  the 
acceptance  of  Assumption  i ;  for  Argument  E,  the  Impact  of  Data  3  and  Rata  4 
depends  on  Assumption  2, 

yhat  happens  when  A  and  B  support  conflicting  hypotheses?  In  a  non -mono  totlic 
system,  the  set  of  assumptions  that  contributed  Co  the  contradiction  are  iden- 
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tlf ltd  and  declared  inconsistent  (it  a  **t)  ,  Then  a  selected  member  of  this 
*ftt  t*  rtjt£t*d,  by  producing  *  justlf lection  (Itself  an  essuiiption}  for  a 
member  of  le*  out! 1st,  As  a  rtsult.,  at  least  ana  of  the  two  erguHcnt*  fails 
<or  has  a  different  conclusion ) ,  and  cons t* Canty  19  restored. 

The  key  point  here  ts  that  conflict  between  A  and  E  causa*  the  tystaa  to  reach 
Inside  tacb  of  the  Arguments.  Conflict  resolution  is  a  process  of  reasoning 
about  fcnnvlfldgcl  what  are  the  weakest  links  in  each  lino  of  reasoning?  where 
would  revision  accomplish  the  most? 

Consider,  on  the  Other  hand,  how  an  uncertainty  calculus  such  as  Shafer's 
would  handle  this  problem.  Ve  examined  the  issue  of  conflict  resolution,  in 
the  context  of  belief  function  theory,  in  sone  detail  in  Section  2.2.2.  There 
wo  found  that.  depe-ndlnE  on  the  degree  ot  conflict 3  and  on  the  existence  and 
degree  of  discounting  for  the  two  ar  Etimeuts ,  we  could  have:  (a)  *n  indecet' 
minate  result  {if  there  la  no-  non-empty  intersection  between  possible  meanings 
of  the  two  arguments),  (b)  exclusive  support  for  hypotheses  in  the  inteEsOC' 
tion  of  meanings  (if  there  is  no  discounting),  or  (c)  strong  support  for  each 
Of  th*  two  conflicting  conclusions).  None  Of  these  alternatives  examines  the 
sources  Of  thft  conflict  and  seeks  insights  regarding  tt*  causes.  Adjustments 
of  discount  races  in  the  light  of  conflict  Are  likely,  moreover,  to  be  Invalid 
in  the  absence  of  pome  exploration  of  reasons  for  the  adjustment. 

Nonetheless,  non -mono conic  systems  as  presently  constituted  are  inadequate  in 
a  number  of  Ways.  Problems  ate  chiefly  attributable  to  their  exactness,  on 
two  levels.  For  example.,  non-monotonic  systems  provide  a  way  of  reasoning 
with  incomplete  information,  i.e.,  by  adopting  assumptions,  tracing  their 
consequences,  and  revising  the:*  If  they  lead  to  an  inconsistency.  But  they 
provide  no  measure  of  the  degree  of  inoompLetcnoss  in  the  support  for  a 
belief,  and  no  concept  of  degree  of  COrtf Lice.  As  we  have  already  noted,  a 
measure  of  this  sort  seems  essential  in  selecting  among  alternative  possible 
revisions . 

On  a  second  level,  the  statements  whose  truth  or  falsity  is  adjudicated  ate 
themselves  exact.  However,  there  is  no  reason  why  similar  principles  of 
qualitative  reasoning  might  not  be  applied  to  probabilistic  or  Imprecise  con¬ 
straints  and  data.  The  need  for  such  a  H mets - re asaming*  capability  is  the 
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chief  conclusion  of  out  cor.T.cnts  in  earlier  discussions  of  Bayesian  and 
Shafer  Ian  calculi.  In  our  view,  non-monotonic  logic  may  have  its  Best  con¬ 
vincing  application  at  a  higher  level,  in  controlling  the  application  of  an 
uncertainty  calculus  itself.  Assumptions  cf  more  than  one  sort- -about  the 
quality  of  uncertainty  assessments t  about  the  independence  of  evidential 
argument* ,  and  about  the  validity  of  steps  in  an  argument- -are  Inescapable  in 
the  application  of  such  a  calculus.  Host  of  these  assumptions  are  not  easily 
represented  In  the  language  of  the  calculus  itself.  Hence,  non-monotonic 
reasoning  may  be  the  appropriate  tool  for  keeping  track  of  assumptions  and 
revising  them  when  they  lead  to  anomalous  results.  As  such,  it  may  be  the  key 
to  a  truly  " Into  1 1  i gent "  or  flexible  application  of  those  model*.  It  t-v 
this  possibility  that  «e  turn  in  S^etfipri  3. 

.OinnuL^ry ,  Non- tatnm  tonic  logic  is  A  computationally  efficient  method  for 
fcnDplrj  with  inooimpiece  information,  i.e.,  for  adopting  assumptions  and 
revising  then  in  the  face  of  conflicting  data.  ■Statement*  are  associated  not 
with  turneries!  indices  of  uncertainty ,  as  in  the  other  theories  we  have 
examined,,  but  with  reasons.  Certain  statements  (called  assumptions)  may  be 
accepted  in  the  absence  of  positive  support,,  as  long  as  certain  other  beliefs 
have  not  been  disproves..  Son-mono tonic  logic  provides  a  natural  method  for 
revising  beliefs  within  independent  lines  of  reasoning  when  they  lead  to  con¬ 
flicting  conclusions.  Unfortunately,  validity  is  diminished  by  the  arbitrari¬ 
ness  of  its  procedures  for  selecting  among  alternative  possible  belief 
revisions,  tfe  argue  that  the  most  useful  application  of  non -monotonic  reason¬ 
ing  may  be  as  a  control  process  for  the  application  of  an  uncertainty 
calculus „ 

2.3.3  Toni  mi  A -ft  model  of  logic.  The  motivation  of  Toulnln’o  Us*s  of  ^rjumenc 
[19 SB}  Is  to  torn  away  from  the  highly  abstract  character  of  traditional 
logic;  to  examine  actual  methods  of  reasoning  in  different  substantive  areas, 
sueh  a*  law  and  medieinn;  and  to  develop  a  theory  of  logic  capable  of  captur¬ 
ing  the  rich  variety  of  methods  that  exist.  In  the  preface  he  states,  “the 
intentions  of  this  book  are  radical,"  He  rejects  as  confused  the  wcoEiception 
of  *  deductive1  inference  which  many  recent  philosophers  [and,  we  may  add.  AL 
researchers]  have  accepted  without  hesitation  as  1  mpatoahle . 11 
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The  basic  framework  of  an  argument,  according  to  Tonluln,  it  *3  follow* 
(Toulmin,,  tt  aL.,  1973): 


Racking 

i 

Warrant 

f  Modal 

Qualifiers .  Claim 
A 

Possible 
Rebuttals 

A  claim,  or  conclusion  whose,  merit*  we  am  seeking  to  establish,  is  supported 
by  grounds,  or  evidence.  The  basis  of  this  support  is  ch*  oxisterico  of  a 
warrant  that  State a  the  general  connection  between  ground*  ami  conclusion: 
o.g.,  *  rule  of  the  form,  if  this  type  of  ground,  then  this  typo  of 
conclusion.  The  backing  provides  an  explanation  of  why  tho  warrant  is 
regarded  as  reliable,  i.c.a  it  provides  evidence  {theoretical  or  empiric*!) 
for  the  existence  of  e  connection  between  ground  »nd  claim..  Had*!  qualifier* 
weaken  or  strengthen  the  validity  of  thr  claim.  Possihl-e  rebuttals  dtautlvat* 
the  link  between  grounds  and  claim  hy  asserting  conditions  under  which  tht 
warrant  t?  invalid.  A.  way  of  reading  this  structure  is:  Grounds,  s.a 
Qualified  Claim,  unless  Rebuttal,  since  Warrant,  on  account  of  backing. 

Toulmin  finds  serious  fault  with  purely  analytical  or  logical  arguments.  In 
such  arguments  fas  contrasted  with  a  substantial  argument)  the  backing  in¬ 
cludes  the  information  conveyed  in  the  conclusion,  ks  a  result,  of  Course f 
the  backing  can  be  no  more  certain  than  the  conclusion  itself.  In  ordinary 
arguments,  by  contrasty  "we  seek  to-  establish  conclusions  about  which  we  are 
not  entirely  confidant  by  relating  them  back  to  other  information  about  which 
we  have  greater  assurance . *  Moreover,  the  certainty  of  the  conclusion  (e,g. , 
a  prediction;  of  a  future  event)  is  seldom  logically  entailed  by  the  grounds 
and  backing  (c.g.,  pest  observation*  of  situation*  like  the  present,  one):  it 
to  merely  made  more  plausible  (fliid  of  course,  rebuttals  may  always  turn  up  to 


if 
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reduce  i  ta  plausibtlt  ty )  .  Toulrain  concludes,  "It  begins  to  be  a  little  doubt¬ 
ful  whether  any  genuine,  practical  arguaent  could  ever  he  properly  analytic,4 

1b  particular,  Toulaln  points  to  weaknesses  in  the  uf*  of  the  logical  term 
1  universal  prcnlte."  His  illustration  (pr  115?  highlights  tin*  veaknea*. 

Jack  is  club’ footed. 

All  club -footed  ran  have  difficulty  in  talking. 

SC,  Jack  has  difficulty  In  walking. 

In  a  logical  pattern  of  analysis,  th*  general  statement  'All.,,1  Is  construed 
as  an  abstract  inference -warrant  for  deriving  the  cone Ins ten  from  the 
evidence.  In  a  real  argument,  we  would  never  supply  such  a  statement  as  beck¬ 
ing  for  a  conclusion.  £>ur  actual  backing  might  be  that  all  club-footed  men 
observed  by  us  have  had  difficulty  walking  (an  empirical  basis  >,  or  that  the 
nature  of  club  foot  suggests  difficulty  in  walking  (a  *»oru  theotacte*! 
backing? T  Toulmin  concludes  (p,  117?,  Hthe  form  fAll  Aha  arc  6' *h  occurs  in 
practical  argument  such  less  than  one  would  suppose  from  logic  tcKtheoka , " 

According  to  Toulmin  (p*  143?,  "the  traditional  patcern  of  analysis  ha»  two 
serious  defects.  It  fs  always  liable  to  lead  us  to  pay  too  little  attention 
to  the  differences  between  the  different  modes  of  criticism,  to  which  argument* 
are  subject" ,  In  addition,  the  traditional  pattern  has  the  effect  of 
"obscuring  the  differences  between  different  fields  of  arginaents,  and  the 
sorts  Of  warrant  and  hacking  appropriate  ee  these  fields." 

on  probability,  Toulnin  rejects  the  suh J e ctfv 1st * s  probability  a*  th*  degree 
o£  belief  on  the  basis  that  thifc  1=  incompatible  with  the  requirement  that  es¬ 
timates  of  probability  b*  reliable.  He  also  rejects  Uie  ohjectivisC 1  *  deflnt- 
ticni  of  probability  in  terms  of  frequent  to# ,  on  the  basis  chat  Such  a  defini¬ 
tion  eoftfosea  the  maantng  o£  ptoh-abil  Icy  (l.e,  ,  as  a  qualification  of  a 
conclusion)  with  the  reasons  fet  regarding  the  event  a*  probable  {!,*.,  the 
observed  £  f equancias) .  In  fact,  he  contend*  that,  "  th*  attempt  to  find  some 
1  thing' ,  in  terms  of  which  we  can.  analyze  the  solitary  word  ^probability '  and 
which  all  probability- statements  whatever  can  be  thought  of  as  really  being 
about,  turns  out  to  be  a  mistake11  (pT  70?  .  He  defines  probability  as  e  modal 
qualifier  assorting,  "whether  backed  by  nathematical  calculations  or  fto,  the 
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characteristic  function  of  our  particular,  practical  probability- s tatements  Is 
to  present  guarded  or  qualified  assertions  and  conclusions"  (p.  93). 

"f aulnii ii1  s  framework  bears  some  Important  resemblances  to  non-monotonic  logic. 
Both  depart  from  traditional  logic  by  providing  for  a  process  in  which  conclu¬ 
sions  are  accepted  unless  other  propositions  (members  of  the  autlist ; 
rebuttals)  turn  out  to  be  true.  There  are  two  important  differences;  {1) 
Tuulnin  proposes  a  highly  differentiated  knowledge  structure.  In  which 
grounds,  warrant,  backing,  cone lus ion,  and  rebuttals  are  distinguished,  while 
nan -mono tonic  logic  proposes  an  essentially  homogeneous,  undifferentiated 
knowledge  structure;  (2)  Toulmin  provides  for  graded  or  qualified  acceptance 
of  conclusions. 

In  Section  3,  we  shall  use  Toulmin 'a  basic  frame work  as  a  starting  point  for  a 
model  of  argumentation  from  evidence  to  conclusion  on  which  a  Shafer tan  belief 
function  is  based.  We  aball  see  bow,  when,  conflict  occur a,  a  process  of  non¬ 
monotonic  reasoning  can  H reach  Inside4  the  arguments,  exploring  potential 
rebuttals t  and  leading  to  revision  (i.a.,  discounting)'  of  the  component  belief 
functions  snd  reduction  of  the  conflict, 

2,3.4  Theory  of  endorsements-  Faul  Cohan' s  (1385)  theory  of  endorsements  is 
another  descendant  of  the  AI  ■based,  logic  tradition.  Although  non- numeric  in. 
character i  there  is  an  interesting  commonality  in  motivation  with  Shafer's 
theory.  Both  methods  foou.5  on  the  validity  of  argument e  that  purport  to  es- 
tabliah  a  conclusion  based  on  evidence.  For  Shafer,  however,  one's  belief 
about  such  an  argument  can  be  adequately  summarized  in  a  numerical  measure, 
the  belief  function,  i.e,,  the  likelihood  that  the  evidence  proves  the 
hypothesis.  To  Cohen,  by  contrast,  it  seems  unnatural  to  assess  the  strength 
of  an  argument  without  actually  examining  the  argument  in  detail.  They  theory 
c£  endorsements  provides  a  cone latent  format  for  representing  such  arguments. 

In  Paul  Cohen's  theory  of  endorsements ,  evidence  is  represented  not  by  mmeri’- 
cal  measures  of  degree  of  belief,  but  by  symbolic  endorsements.  A  given 
proposition  1*  associated  with  a  ■ledger'"  of  confirming  and  dis confirming 
evidence.  Each  item  of  evidence,  in  turn,  ia  associated  with  a  set  of  posi¬ 
tive  and  negative  11  endc r s cments , *  which  State  gEOUfids  for  believing  or  dis¬ 
believing  a  link  between  that  evidence  and  the  hypothesis,  finally,  Che 
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theory  contains  rules  for  ranking  different  types  of  endorsements ,  for  deter¬ 
mining;  when  they  qualify  a  hypothesis  for  acceptance,  and  for  resolving 
conflicts , 


Cohen's  theory  has  been  implemented  in  a  prototype  system  called  SOLOMON 
I  Cohen,  1935).  The  user  of  Cohen's  -system  supplies  primary  data  and  inference 
rules  with  endorsements  { e .  g . ,  a  rule  may  be  endorsed  MAYBE  -TOO- GENERAL)  .  En¬ 
dorsements  of  a  rule  and  the  propositions  to  which  it  is  applied  propagate  to 
the  conclusion  of  the  rule  (ana  „  as  noted  above,  can  be  thought  of  as  endorse¬ 
ments  for  the  linkage  between  the  evidence  and  the  conclusion) .  The  system 
must  he  supplied  with  criteria  fox  when  a  proposition  is  adequately  (for  a 
particular  purpose)  endorsed;  these  criteria  depend  on  the  goal  as  well  as  on 
the  endorsements  for  the  proposition. 

It  is  worth  noting  that  Cohen's  concept  of  an  endorsement  encompasses  a 
variety  of  distinguishable  elements  of  Toulain'a  framework:  i.e.,  warrant, 
backing,  and  rebuttals  may  all  serve  as  (positive  or  negative)  endorsements 
affecting  the  link  between  ground  (evidence)  and  conclusion, 

Cohen's  approach  has  a  unique  simplicity  and  transparency,  and  may  capture  a 
significant  aspect  of  actual  rnaaontn-g  (the  dependence  of  belief  on  qualita¬ 
tive  faera  about  the  available  evidence),  Nevertheless ,  as  With  the  Other 
theories  reviewed  here,  the  utility  of  Cohort'*  theory  depends  bn  ttTtnl  urt- 
re solved  IssueSi  ,  First,  the  ranking  Of  endorsements  is  entirely  qualitative, 
Cohen  expense*  concern  chat  for  tome  proposes  it  might  be  desirable  to 
specify  numerical  measure*  of  the  strength  of  endorsements,  but  seems  to 
regard  this  as  incompatible  with  the  symbolic  reasoning  tradition  of  A,!, 
Numerical  measures  of  strength  of  endorsements,  coupled  with  *  mechanism  for 
combining  them,  would  provide  a  resolution  of  the  second  problem;  the  ad  hoc 
nature  Of  the  mechanism  for  ranking  endorsement*,  Cohen  assumes  that  the  sys¬ 
tem  is  supplied  with  rankings  for  individual  endorsements,  hot  there  exists 
only  an  adf  hoc  mechanism  for  tanking  groups  of  endorsements .  Thus,  the  deci¬ 
sion  of  whether  one  proposition  Is  better  endorsed  than  another  is  to  Some 
degree  arbitrary,  and  the  rules  can  be  insufficiently  powerful  to  derive  a 
conclusion,  third,  endorsements  are  tokens  ^to  the  system).  The  rich  as¬ 
sociations  a  human  would  bring  to  an  endorsement  of,  e.g,„  HAYBE -TOO -GENERAL, 
are  Opaque  to  Cohen'S  system.  (It  is  interesting  that  Cohen's  system  was 

-  67  - 


developed  In  response  tn  a  perception  of  the  opacity  of  numerical  probability 
judgments,  but  bis  system  suffers  to  some  extent  from  the  sane  problem.) 
Finally,  Cohen's  theory,  Ilka  the  numerically  based  theories  reviewed  In  'Sec¬ 
tion  2.2r  would  benefit  from  a  "meta-reasoning"  capacity  for  re-evaluating  en¬ 
dorsements  as  an  argument  proceeds . 

2  A  Fi obab lllty/Lcfilc .jynthftg^B 

2,4,1  Model  based  on  Toulmln's  framework,  Lagoaasino  and  Sage  <  1 9 B 5 >  present 
a  framework  for  imprecise  inference  that  purports  to  combine  Toulrein’e  logic 
of  reasoning  and  the  calculus  of  probability.  In  fact,  we  would  argue  that 
their  use  of  Toulmln  is  quite  incidental  to  their  basic  approach,  A  better 
characterization  is  that  Lagcmasino  and  Sage  attempt  to  probability  tradi¬ 
tional  logical  relationships. 

Lagomas ino  and  Sage  claim  to  use  Toulmin' s  model  of  argumentation  to  frame  the 
relations  among  events,  and  to  structure  an  inference  model.  In  particular, 
the  relationship  between  two  events,  grounds  D  and  claim  C,  are  represented 
as : 


w  -  (b+G) 

\ 

t 


ft  -  {D^c,  D,  C,  ,H+1 


{Their  use  of  the  term  rebuttal  to  Include  the  negation  of  grounds  or  claim 
appears  at  odds  with  Toulmin’ a  (195E3}  definition  of  rebuttal  as  "indicating 
circumstances  in  which  the  general  authority  of  the  warrant  would  have  to  he 
set  aside 11  {pT  101  >,  1 

Probabilities  serve  as  modal  qualifiers  and  the  c*lculo#  of  probability  i« 
used  to  combine  or  aggregate  assessments.  Within  this  structural  ho  eh  m?et- 
tainty  and  Imprecision  about  urw*rc*in.ty  otc  represented,  Uncertainty  about 
the  validity  of  a  proposition  or  strength  of  a  claim  Is  presented  as  a 
probability.  Imprecision  about  uncertainty  is  represented  a  a  ranges  on. 


probabilities,  [Toulmin  (195B)  uses  probability  only  as  *  suqd*l  qualifier  an 
claims » ] 

Lagomastno  and  Sage  derive  a  set  of  cans  la  tent  relationship  equations  (CRE) 
based  on  logically  cotta  intent  relationships  empng  claims,  grounds,  and  «*t' 
ranes  (collectively  called  premises)  and  possible  rebuttal*  and  the  rules  of 
probability,  [Again,  the  approach  diverges  in  apt tit  from  Toulmin  (1950)  ,  who 
dismisses  as  trivial  the  notion  of  formal  validity  by  noting,  " provided  that 
the  correct  warrant  is  employed,  any  argument  ten  be  expressed  in  the  form 
'Data  ['Grounds  In  hi  a  later  terminology];  UArranc ;  so  Conclusion*  and  so  be¬ 
comes  formally  valid"  (p,  119),]  The  following  sot  of  Unfair,  independent 
equations  and  inequalities  is  the  set  of  CREs  for  the  above; 

P(D_*G)  +  P(L-^C)  +  P(D)  -  2 
E(D^jC)  +  P(D^£)  +  P(C)  -  2 
EfD-tC)  ■+  P(I}^?C)  -  F(C)  -  1 

o  £  PC)  S  1- 

This  framework  is  used  ta  derive  probability  statements  concerning  any  premise 
or  rebuttal  by  solving  two  linear  programs.  The  CREs  are  the  set  of 
constraints r  and  the  objective  functions  are  determined  by  the  premise  or 
rebuttal  of  interest,  namely  min  P< ' )  and  max  P{r), 

As  they  stand,  the  basic  sets  of  CREs  do  not  say  anything  interesting.  That 
is,  each  P(')  has  a  range  of  0  to  1.  These  ranges  are  narrowed  only  by  the 
addition  of  information. 

Information  is  represented  in  this  system  as  additional  constraints ,  The  fol¬ 
lowing  are  examples  of  constraints  that  might  be  provided  by  information: 

F(D->C)  <  ZPCD-jC), 

P£D_*C)  >  P(C^D), 

P(D)  -  ,79; 

In  Some  casts  information  might  Contain  a  tsirm  that  dots  not  appear  In  the 
canonical  representation  of  CREs.  The  second  example  above,  which  tortCAiriS 
the  term  F(C->D)  ,  is  such  a  case.  Such  relationships  can  be  converted  to 
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canonical  form  using  equivalence  relationships  H  In  Che  example,  the  equiv¬ 
alence  Cr^D  s  -?C  is  invoked  eo  Chat  PfC-^D)  —  .  A  similar  procedure 

can  be  Used  Co  F.r amfottn  inforaatlon  that  is  provided  In  Other  ways.  An  im 
portent  casc  is  cOrdlCional  probability  statements ,  For  example,.  Che  state¬ 
ment  P(D|C)  >  .6-  ten  be  transformed  to  canonical  form  as  follows: 


F(D|G)  >  ,6 

tmus.  *.  i 

PCC> 


P(C> 


>,6 


F(D-?C)  +  ,GP(C)  <  1. 


the  itu lit;  1  ten  be  expanded  to  represent  a  whole  network  of  events, 
PJ.ctorially ,  Lagomaslno  and  Sage  show  such  a  network  os, 


but  from  the  generality  of  Chefr  fraaevork  and  discussion,  the  method  does  not 
appear  restricted,  to  a  spanning  tree.  The  link  between  any  pair  of  nodes  in 
the  network  may  consist  of  a  subset  of  basic  premises  and  possible  rebuttals. 
As  stated,  links  appeaT  to  be  quite  general  [presumably  soma  node p $  data 
could  become  another  node's  rebuttal) ,  and  thu*  the  approach  appears  to  lack 
the  intrinsic  structures  of  TeialntlnfJ  logic,  E^cli  relationship  Is  modeled  as 
a  net  of  CREs,  and  the  set  of  all  CftEg  and  additional  information  constraints 
art  constraints  in  the  linear  pro  graft,  This  aystoft  of  relationship*  tm*y  be 
solved  to  determine  the  Tango  t>f  probability  of  any  factor  of  interest.  If 
the  linear  program  has  no  feasible  EOluTtCn,  chon  those  relationships 
specified  arc-  logically  Inconsistent,  {Ibis  suggests  an  extension  of  the 
method  using  goal  programming  techniques,  but  a  logical  basis  for  such  an  ex¬ 
tension  is  not  apparent, ) 

LagOtedSlPO  and  £ag;e  do  not  Explain  h&w  the  informational  relationships  should 
be  assessed  nr  aS-tlmatecL,  or  exactly  how  new  Information  changes  a  set  of 
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constraint*.  Horeovtr,  Infonwtlon  that  luo*etU  as  well  as  tighten*  bound* 

(I .£. ,  non-n»nOtufiIc  reasoning  about  probabilities)  Is  presumably  possible , 
but  LagomaatBO  and  Saga  art  silent  on  how  this  could  occur  In  their  framework  ... 

Hot  is  tha  process  of  specifying  nodes  in  the  network  ever  do  lined  precisely, 
LagonasiiKi  and  Sage  state  that  structuring  a  model  involves  "the  specification 
of  alternative:  hypotheses  at  each  node"  and  that  "the  set  of  hypotheses  under 
consideration  at  each  node  should  he  mutually  exclusive  and  exhaustive." 
however,  hypotheses  are  also  limited  CO  propositions  that  obey  the  consistency 
relational  equations .  It  Is  unclear  how  thin  constraint  on  assessment  can  be 
enforced. 

According  to  Lagofnaslno  and  Sage,  the  method  allows  for  information  to  be  en¬ 
coded  about  both  causal  Ce.fi.,  ?(D-?C))  and  diagnostic.  (*,£„,  p£t>|C)) 
reasoning.  This  claim  highly  dubious  and  r ■presents,  we  think,  the  laost 
serious  weakness  in  this  approach,  P(D-^c)  canoor  plausibly  by  construed  as 
the  probability  (or  strength)  of  a  causal  link  between  D  and  C  as  long  as 
MD-kC“  ia  interpreted  within  traditional  logic  (as  the  authors  clsarly 
intend),  Within  traditional  logic  “DH PCm  Is  true  unless  C  and  £  etc  both  true 
(this  is  the  interpretation  used  by  bagon^sino  cod  Sago  in  the  derivation 
described  above  regarding  E(D|C)  a«d  P(P-?C)),  Ewe  this  is  far  weaker  than  a 
causal  connect ten;  "if  the  aoon  is  made  of  green  cheese,  then  the  threat  is 
an  SA-dH  would  be  true  In  traditional  logic,  since  the  antecedent  is  falsej 
yet  clearly  there  is  no  causal  connection,  A  warrant  curst  rued  in  this  way  is 
quite  trivial;  when  the  antecedent  is  true,  the  warrant  merely  states  that 
the  conclusion  is  true,  it  gives  n*  indication  ot  any  physically  real  connec¬ 
tion  between  the  two. 

An  alternative  Interpretation  of  "D-bC"  is  as  an  implicit  universal 
generalisation ,  i,e.,  all  instances  of  t?  arc  also  instances  of  C,  This  runs 
into  the  objections  broached  by  Toulmim.  In  particular,  a  SingLe  coun¬ 
terexample  (t.e.,  a  case  of  D  and  not-C)  is  sufficient  to  establish  the  fal¬ 
sity  of  such  a  genera Lizat ion j  i.e.,  P(Et-^C)  would  be  zero.  Yet  we  often  as¬ 
sert  the  existence  of  causal  relations  {e,grp  *the  baseball's  hitting  the  win¬ 
dow  caused  it  to  break")  even  when  the  relationship  is  subject  to  exceptions 
£sorae  baseballs  would  not  have  broken  some  windows). 
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In  the  light  of  these  problems,  two  broad  courses  of  action  are  avail able i 
{1)  we  tan  interpret  H  '•?"  outside  of  classical  logit.  e.g.,  in  terms  of  modal 
logics  for  causality.  In  this  approach,  D^C  is  true  (i.e,  t  D  causes  C) ,  for 
example,  only  if  C  is  true  in  all  the  physically  possible  worlds  where  D  ia 
true.  Perhaps  the-  degree  to  which.  D  causes  C  is  the  percentage  of  D  worlds 
where  C  is  also  true.  This  option  involves  enormous  difficulties  computa¬ 
tionally  {i,B.t  in  specifying.  CR.E1  s  within  a  modal  framework)  and  semantically 
(i,e,  ,  In  defining  the  nation  of  a  "possible*  world  precisely  enough  so  they 
can  be  counted)  r  (2)  A  stapler  option  is  to  take  a  causal  (or  other 
theoretical)  link  as  a  basic  unanalyzed  not ion 1  and  to  as a ess  the  probability 
of  its  existence.  This  is  essentially  Shafer’s  approach  iti  his  notion  of 
evidential  support.  Thus,  mE(H)  can  be  interpreted  (with  qualifications  dis¬ 
cussed  in  Section  2.2.2  above)  as  the  chance  that  the  evidence  E  proves  or  es¬ 
tablishes  the  hypothesis  31.  In  cases  of  causal  reasoning,  this  is  the  chance 
that  JS  causes.  E3  or  that  H  causes  S.  (For  example,  the  reliability  of  a  wit- 
hess  who  clalflts  char  artillery  is  present  is  Simply  the  probability  that  his 
testimony  was  in  an  appropriate  Causal  relation  to  the  presence  of  artillery.) 

In  the  framework  to  be  described  below,  we  in  essence  adopt  course  (2), 
However,  we  supplement  Shafer's  simple  representation  by  an  explicit  analysts 
Of  the  basis  of  the  alleged  evidential  link  in  each  argument:  t.e.,  its  back¬ 
ing  and  its  possible  rebuttal*. 

2,4,2  Hllsaon'a  probab  1 1 1  s tt o  logic,  flllason  <3,934}  presents  an  approach 
that,  on  the  surface,  appears  very  similar  to  that  of  Lagomasino-  and  Sage, 
trilsson  proposes  *  method  for  characterizing  the  troth -values  of  first-order 
sentences  as  probabilities.  The  method  is  applicable  to  "any  logical  system 
for  which  the  consistency  of  a  finite  set  Of  sentences  can  be-  established,  " 
Tbi*  method  is  presented  *%  a  generalization  of  classic el  f tret- order  logic 
that  Is  '’appropriate  for  representing  and  reasoning  With  uncertain  knowledge, * 

Nilsson  starts  by  specifying  a  logical  sentence  whose  truth  values  are  of 
interest.  These  could  be  any  conjunction  of  sentences  of  first-order  logic. 
For  example,  a  Sentence  could  he: 

S-  t Oy)A(y) t  (Vx)[A(x)oB(x)  ]  h  (VZ>B<2))  + 
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The  truth -value  of  any  one  of  the  three  components  of  this  sentence  is  hounded 
by  logical  consistency  relationships.  For  example ,  all  three  components  could 
be  true;  this  is  logically  consistent.  However,  the  three  components  could 
not  all  be  falsa;  this  la  inconsistent,  Mote  chat  this  bounding  is  on  the 
combination  a£  truth-value  for  all  components  of  tht  sentence,  not  for  any  in¬ 
dividual  component.  Indeed,  in  the  example  any  component  could  be  true  or 
false  (value  of  0  or  1) ;  it  is  only  combinations  that  are  prohibited. 

Bach  permissible  combination  of  truth- valuta  represents  a  "possible  world, " 
thtft  Is,  a  possible  combination  of  true  and  false  components.  If  the  truth  or 
falsity  of  each  component  is  represented  by  the  -number  1  es  fl  respectively, 
then  a  possible  world  can  be  represented  as  a  three -dimensional  vector  of 
«ercs  and  ones  for  a  permissible  state,  In  the  example  above,  the  following 
five  vectors  represent  all  possible  worlds: 

11.1,1] 

n.o.ii 

[1.0,0] 

[0.1,1] 

If  each  component  of  the  sentence  ia  thought  of  a*  a  dimension  In  three - spec* , 
then  possible  worlds  are  represented  as  five  points  in  chat  space, 

Nilsson  next  generalizes  the  interpretation  of  the  vector  by  allowing  prob¬ 
abilistic  ‘'smearing"  over  worlds,  This  is  done  by  allowing  probability  dis¬ 
tributions  over  different  worlds  and  by  constraining  these  probabilities  to  be 
logically  11  permissible .  "  The  implication  of  the  definition  of  probabil¬ 
istically  permissible  is  to  constrain  probabilities  to  be  within  the  convex 
region  bounded  by  the  set  of  possible  worlds  as  defined  above ,  This  lead*  to 
the  following,  rather  tortured,  interpretation  of  a  probability  of  n  Component 
of  e  sentence: 

the  probability  of  a  component  is  the  sura  o£  probabilities  of  all  pos¬ 
sible  worlds  in  which  it  is  true. 

Since  consistency  is  a  criterion  that  rarely  determines  probability  uniquely, 
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Nilsson  Investigates  additional  technique*.  Ha  be th  solves  for  "maxieeun 
entropy*  probabilities  and  the  a*  produced  by  geometric  projection,  Heither 
method  is  provided  with  a  basis  or  de fended r  This  step  might  take  plate  after 
the  permissible  region  la  reduced  by  additional  conattaints  on  the  probability 
values  of  sentences  r  fro  mention  is  made  of  the  source  cf  thes*  additional 
constraints.  So,  th&  output  of  frllsicn1*  model  Is  either  a  description  of  a 
region  of  permissible  probabilities  or  a  probability  that  Is  determined  by  an 
ad  hoc  method,  although  one  could  presumably  assess  probabilities  of  "possible 
worlds11  to  derive  th*  do  tired  probabilities  C  ignoring  rh*  a=soSBmont  problem). 

The  principal  difficulty  of  Nilsson1*  approach,  from  the  present  viewpoint,  is 
that  {like  L^gocasino  and  Sage)  it  falls  to  capture  true  causal,  or  other 
evidential,  relationships .  As  noted  above,  these  are  not  well  represented  in 
the  first -order  predicate  calculus,  and  it  is  not  clear  how  effectively 
Nilsson.'  e  method  could  be  extended  to  handle  consistency  constraints  among 
sentences  in  a  modal  logic.  In  any  case,  it  is  clear  that  the  assessment  task 
would  be  enormously  complicated  (e.g. ,  by  the  Introduction  cf  possible  worlds 
containing  sets  of  possible  worlds). 


$.0  AJT  ADAPTIVE  FRUfiABIhlSTIC  IHFE.REHCE  FRAMEWORK 


This  section  describes  an  lnnov« c ive  inference  f csp.fv ork ,  for  uas  In  expert 
systems.  The  framework  was  developed  to  address  cone  of  the  sht r t com Ing s  of 
current  approaches  to  reasoning  in  uncertain  domains. 

Homan  experts  typically  Use  an  iterative  process  of  reassessment  and  revision 
when  they  reason  in  complex  dona  Ins  characterized  by  uncertainty.  One  or  more 
models  are  tentatively  adopted  (usually  requiring,  assumptions  that  are,  at 
beat,  only  approximately  satisfied)  and  conclusions  are  derived.  The 
plausibility  of  the  results  is  assessed,  by  testing  model  results  against  in¬ 
tuition  or  against  the  results  of  other  models.  Sometimes,  in  addition,  the 
model  makes  predictions  which  can  be  tested  against  actual  observations .  When 
results  of  an  analysis  moot  Such  tests  of  plausibility,  confidante  in  model 
assumptions  is  enhanced;  otherwise,  the  human  analyst  searches  for  ways  to 
relax  or  change  model  assumptions  to  achieve  more  acceptable  results. 

Current  approaches  to  expert  systems'  reasoning  under  uncertainty ,  however, 
tail  Co  capture  this  Iterative  revision  process.  Usually,  some  form  of  prob¬ 
abilistic  model  (o . g. ,  Bay£s ,  Shafer,  or  certainty  theory)  is  encapsulated 
within  the  modular  rules  used  by  the  system  In  reasoning.  He  provision  Is 
made  for  altering  the  probabilistic  model  to  account  for  the  extent  to  which 
results  confirm  or  dlsconflrm  model  expectations..  In  many  of  these  sys  teats, 
moreover,  there  is  no  explicit  representation  of  the  completeness  or 
reliability  of  a  probabilistic  argument- -of  the  extent  to  which  the  analysis 
is  "shiftable'  with  new  evidence. 

Another  problematic  feature  of  current  expert  systems  ia  the  confounding,  of 
knowledge  about  uncertainty  with  utility,  or  knowledge  about  preferences.  For 
example,  the  MYCIU  system  handles  a  disease  it  considers  serious  (a  utility 
consideration)  by  increasing  ita  certainty  factor  (acting  "as  if"  it  ia  more 
probable  than  warranted  by  the  evidence).  Another  common  tactic  is  to  embed 
utility  considerations  in  the  ordering  of  rule  application.  Such  confounding 
makes  it  very  difficult  to  maintain  a  knowledge  base  in  the  face  of 
Independently  shifting  preferences  and  beliefa  and  to  communicate  system 
reasoning  to  user*. 
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Our  inference  framework  Ls  de signed  to  capture  important  features  of  the 
iterative  revision  process  characteristic  o£  human  reasoning.  The  framework 
takes  explicit  account  of  the  "shif tability"  of  model  assumptions,  searching 
for  potential  revisions  among  those  arguments  identified  as  least  reliable. 
Uncertainty  is  kept  separate  from  preferences,  allowing  for  greater  normative 
justification  of  system  results,  for  more  informative  user/system  fiyteract ion, 
and  for  rapid  adaptation  to  changes  in  system  goals  (this  last  feature  being 
especially  important  in  time -a tressed  military  environments) , 

Figure  J - 1  illustrates  the  representation  of  a  single  evidential  argument 
within  our  reasoning  framework.  The  representation  is  based  on  Toulmin' s 
(Section  1.1.1)  proposed  model  of  an  argument.  The  evidence  corresponds  to 
Touimin's  grounds.  The  claim  (the  conclusion  in  Figure  3 - 1 )  is  linked  to  the 
grounds  through  the  warrant  (the  rule)  ,  with  backing  provided  by  a  causal  of 
other  theoretical  nodel.  In  our  framework,  however ,  the  conclusion  ls  not  a 
definite  hypothesis,  but  rather  a  belief  function  which  represents  the 
system's  state  of  uncertainty  about  the  range  of  possible  hypotheses.  Thus, 
the  rule  links  evidence  to  a  belief  function  over  possible  hypotheses.  This 
fits  with  Toulain1  s  conception  of  the  role  of  probability  as  modal  qualifier 
of  a  claim  "the  belief  function  represents  a  qua lifted  (by  a  belief  function) 
claim,  linked  to  the  evidence  through  a  rule  for  computing  the  belief 
function,  with  the  rule  in  turn  backed  by  a  causal  of  other  theoretical  model. 
Finally,  Toulmin'e  framework  allows  for1  representing  the  reliability  o£  the 
evidence,  through  what  he  calls  possible  rebuttals .  In  Figure  3-1,  the  pos¬ 
sible  rebuttals  act  to  discount  the  belief  function.  In  Section  2.2.2,  in  our 
discussion  of  belief  functions,  we  saw  that  discounting  of  belief  functions 
was  a  means  of  incorporating  the  Judgment  that  there  was  some  chance  that  the 
evidence  and  the  hypothesis  were  net  linked,  i.e,,  that  the  evidential  link 
was  Invalid  due  to  some  deactivating  factor r 

As  shown  In  Figure  3-1,  this  infere^C*  framework  has  the  *dvanfcEges  ef 
Shafer **  belief  function  theory:  in  providing  a  measure  of  the  reliability  of 
Evidential  argument*,  In  permitting  modular  analyses  of  separate  lines  of 
argument ,  and  in  the  possible  use  of  Bayexlau  (as  well  *S  Other)  type*  of 
medals  as  special  oases. 
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®  PROVIDES  rtASUftE  OF  RELIABILITY  OF  EVlDEMTIW, 
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EVIDENCE 

(J)  CAT  USE  "BAYES  I  AIT  rtQLELS  WHERE  APPROPRIATE  AS  A 
SPECIAL  CASE 

IN  ADDITION: 

©  factors  Influencing  reliability  of  argument  are  made 

EXPLICIT 


Figure  3-1 
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A  crucial  additional  feature  of  our  system,  however,  is  that  belief  functions 
are  not  represented  as  "black  boxes; 11  the  system  Is  provided  with  a  frame 
(Figure  3-1}  representing  tha  basis  for  computing  the  belief  function, 
together  with  knowledge  of  the  factors  which  could  discredit  the  link  between 
the  evidence  end  conclusion.  Thus,  the  system  has  access  not  only  to  numeri¬ 
cal  measures  of  uncertainty,  but  to  the  structure  of  the  arguments  on  which 
these  measures  are  based.  This  feature  provides  the  potential  for  * reaching 
Inside"  an  argument  and  altering  the  resultant  belief  function,  the  alteration 
being  based  on  the  firmness  of  the  c exponents  of  the  argument, 

Figure  3*2  illustrates  the  combination  of  two  arguments.  The  belief  function 
representation  provides  for  a  straightforward  means  of  combination:  the  ap-- 
plication  of  Dempster'S  Rule,  When  the  two-  argmsente  are  in  basic  agreement, 
confirming  each  other,  the  inference  procedure  ends  with  the  application  of 
Dempster Fs  Rule,  However,  it  Is  possible  that  the  arguntnts  at*  In  conflict, 
that  they  assign  significant  belief  to  mutually  ey elusive  conclusion* .  Such  * 
situation  was  discussed  in  Section  2.2 r2,  and  Illustrated  in  Figure  1-3.  When 
such  conflict  occurs,  the  system  (as  would  a  human  expert)  takes  it  a* 
evidence  that  one  or  more  of  the  component  argument*  may  ha  flawed;  and  it 
set*  out  to  determine  where  the  flaw  is,.  As  shown  in  Figure  3' 2,  tha  proe**v 
of  conflict  resolution  in  this  system  can  involve  the  application  of  different 
strategies  across  several  different  stages. 

(1)  The  first  step  of  conflict  resolution  is  to  search  for  information  that 
may  discredit  one  of  the  component  arguments.  Thus,  the  system  tries  to  ob¬ 
tain  information  about  the  factors  influencing  the  discount  rate;  this  search 
is  prioritized  by  balancing  the  cost  of  information  search  against  the  poten¬ 
tial  benefit  of  the  information  in  conflict  reduction.  The  result  of  the  in- 
formation  search  may  be  to  Increase  belief  in  the  presence  of  a  factor  dis¬ 
crediting  one  of  the  arguments;  if  this  result*  in  lowering  th«;  conflict  to  an 
acceptable  level „  the  conflict  resolution  process  i*  concluded. 

(2)  As  a  second  step,  however,  the  system  may  sank  additional  independent 
evidence  related  to  the  conclusion.  This  typically  will  result  in  an  increase 
in  conflict*  but  It  may  provide  insight  into  which  component  argument  is 
flawed  (by  supporting  only  one  of  the  original  conflicting  arguments)  ,  Then, 
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Adaptive  Revision  of  Reliefs 


by  Looping  back  to  step  (1),  the  system  utilizes  this  additional  in £o rma M rvp, 
to  reprioritize  its  search  for  the  presence  of  discount  factors. 

(3)  Thirdly,,  the  systet  may  explore  modifications  in  the  theoretical  basis 
for  one  of  the  conflicting  arguments,  For  example ,  the  system  may  decide  to 
modify  the  causal  model  underlying  one  of  the  inference  rules,  or  it  may 
decide  that  the  arguments  are  not  based  on  independent  evidence t  invalidating 
the  applicability  of  Dempster's  Rule.  Clearly,  such  modifications  are  at  a 
higher  level  than  those  discussed  before,  and  require  a  system.  with  a  high* 
level  adaptive  capacity  for  altering  the  structure  oE  its  own  reasoning 
processes  in  the  face  of  unanticipated:  observations. 

(4)  Finally,  if  significant  conflict  remain.* ,  the  .system  discounts  Ali  coin* 
ponent  arguments  by  an  amount  reflecting  their  contribution  to  thfc  conflict,. 
This  reflects  the  conclusion  that  scone  element  in  at  least  one  of  these  argu¬ 
ments  Is  flawed,  but  that  insufficient  data  are  available  (at  an  acceptable 
cost)  to  identify  the  flaw  precisely* 

In  the  demonstration  system  (Section  k  below) ,  steps  (1)  and  (4)  above  have 
been  implemented. 

The  process  of  discounting  belief  functions  when  conflicting  evidence  1*  en¬ 
countered  is  non-monjotonlc  in  character,  and  possesses  important  parallels  to 
Doyle's  (1$79)  non-Honotonic  logic,  discussed  above  in  Section  2.3,2.  In  4 
strict  Shaferlan  system,  the  input  belief  functions  remain  fixed  throughout 
Che  analysis,  and  combination  of  these  functions  by  Dempster's,  K,ulft  After  the 
addition  of  new  evidence  always  reduces  the  amount  of  mas*  allocated  to  the 
universal  act.  Yet  Shafer  Mrflaelf  responded  to  the  example  of  Figure  2-4, 
where  the  existence  of  conflict  resulted  in  a  counter-intuitive  result,  by 
proposing  a  non -monotonic  revision  (discounting)  of  tile  Input  belief 
functions.  Our  framework  provide*  *  ctcchaniew;  for  implementing  this  non¬ 
monotonic  process  within  an  expert  system.  Bell  of  factions  are  represented 
as  based  on  assumptions  (for  example,  until  evidence  to  the  contrary  is 
obtained,  the  system  acts  as  if  a  particular  discount  factor  is  absent).  Uhen 
conflict  among  belief  functions  is  observed  (conflict  being  analogous  to 
Boyle's  syatem  encountering  A  contradiction  among  sentences),  the  system 
searches  for  a  "culprit  assumption*  (a.g.,  the  absent*  of  the  abov* -mentioned 
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discount  factor)  and  looks  for  evidence  to  discredit  the  assumption  throng  a 
test  Which  night  establish  the  presence  of  the  factor.  The  result  is  a 
modification  of  the  asauirptions  leading  to  one  of  the  belief  functions,  and 
hence  a  discounting  of  that  belief  function  and  a  reduction  of  conflict.  It 
ie  worthy  of  note  that  In  our  systez.  {unlike  Doyle's)  the  prioritisation  of 
the  search  for  "culprit"  assumptions  is  made  explicit,  and  Is  based  on  a 
benefit-cost  tradeoff,  Moreover,  if  a  revision  in  assumptions  cannot  be  jusj 
tlfied  (by  the  outcome  of  some  test)]  the  revision  does  not  take  place,  and 
the  system,  uaea  the  device  of  across-the-board  discounting  (step  (£))  to  repj 
Tesent  the  overall  loss  in  confidence  in  its  system  of  beliefs. 


-  81 


4,0  APPLICATION  TO  A  PROTOTYPE  ADAPTIVE  ROUTE  REPLANNING  {AWt)  SYSTEM 


4 . 1  Implement  atlon 

Our  Inference  framework  has  been  Implemented  In  a  emal 1  -  a c al e  prototype  system 
designed  to  support  pilots  on  deep  Interdiction  or  offensive  eouflteratr 
missions ,  The  focus  of  the  demons tret ion  software  Is  In-flight  route  replan¬ 
ning  in  the  face  of  strategic  pop-up  threats,  i.s,,  threats  which  are  dis¬ 
covered  at  sufficient  ranges  to  permit  time  for  rerouting  the  aircraft  (in 
contrast,,  for  example ,  to  the  immediate  evasive  action  required  against  an 
airborne  mi  as  lie)  ,  Further,,  the  main  focus  among  strategic  threats  Is 
surface -to -air  missile  sites  or  artillery. 

The  Adaptive  Route  Replenner  (ARR)  Is  assumed  to  begin  Its  mission  with  prior 
information  (represented  by  a  belief  function)  about  the  Location  of  a  par¬ 
ticular  surface abased  anti -air  threat.  During  flight □  the  system  is  notified 
of  a  second  threat  localization  (from  a  SAR  signal) ,  which  may  be  more  or  less 
distant  from  the  likely  location  of  the  first  threat,,  This  second  piece  of 
Information  is  likewise  represented  by  a  belief  function  for  the  location  of 
the  threat.  As  part  of  Its  Inference  task,  the  system  miat  assign  degree*  of 
belief  among  three  possibilities ;  (I)  the  two  belief  functions  represent  the 
same  threat,  in  the  same  location;  (2)  the  original  threat  has  moved  to  a  new 
location;  and  (l)  Che  second  signal  comes  from  an  entirely  new  threat,  pre¬ 
viously  undetected. 

To  perform  this  task,,  the  AER  utilizes  Its  knowledge  about  the  original  threat 
location  and  the  location  of  the  new  signal,  as  well  as  general  information 
such  as  how  far  threats  can,  move,  how  the r-ough  the  prior  area  intelligence  was 
(and  therefore,  hov  likely  to  have  missed  a  threat),  and  how  far  from  the 
original  throat  a  second  threat  is  likely  to  be,  (Other  kinds  of  information, 
e.g, ,  characteristics  of  the  SAR  signal  that  might  help  to  identify  the  typo 
of  threat  and  establish  whether  It  la  the  same  or  different  es  che  original 
threat ,  wpuld  he  included  in  a  full --Scale  operational  system.  Chi*  to  the  i?H' 
straifits  of  a  limited  Fhase  I  effort,  it  w**  decided  CO  incorporate  only  a 
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small  subset  of  potentially  available  information  sufficient  co  illustrate  the 
inference  mechanisms .  ) 

Each  of  the  above  pieces  of  evidence  la  represented  BK  a  belief  function,  as 
described  in  Section  2,2,2 r  The  system  operates  on  these  belief  functions  in 
three  passes.  (1)  forworn? 'Chaining  CaafrlrtaeiCu')  of  belief  function#  Itflng 
Dempster'S  Rule.  The  result  Is  a  belief  function  over  the  three 
po s s ib  1 1 1 1 its ” unchangt d ,  ranved,  ot  di  fferent  ■  ■  ar;  wt  11  as  a  belief  function 
over  the  location  of  the  threat (s)  under  each  of  the  possibilities.  The 
analysis  ends  her*  if  there  is  no  significant  conflict  in  the  resulting  belief 
function;  otherwise ,  a  second  pass  Is  taken.  (II)  t'rlOtltlza.tlon  snif 
(possible)  performance  of  tests.  In  the  second  pass,  the  system  decides  on  an 
action  to  take  (*.(.,  test  for  ECU  in  the  area)  that  might  discredit  one  of 
the  belief  functions  and  result  in  a  lessening  of  conflict.  If  the  tost  is 
performed,  and  if  a  non ' mono tunic  process  of  discounting  occurs  based  on  the 
tost  result,  then  the  euabinatlon  of  belief  functions  is  recomputed.  Again, 
analysis  ends  if  resoles  arc  satisfactory.  (Ill)  Across -the- board  discounting 
of  all  arguments ,  Ochu  rtf  go,  all  component  arguments  ate  discounted  based  on 
theit  contribution  to  the  conflict,  and  Dempster's  Rule  is  again  recomputed. 

After  arriving  at  a  satisfactory  inference  with  respect,  to  threat 
classification,  ARP  derives  the  action  implications  of  the  inference. 
Specifically,  it  Combines  its  beliefs  -itb  regard  to  whether  the  threat  is 
unchanged,  moved,  or  new  with  Its  knowledge  of  the  danger  contours  associated 
with  the  threats,  and,  based  on  this  infonsat ion,  evaluates  several  candidate 
routes  and  selects  the  beat,  (The  present  implementation  does  not  generate 
routes,  nor  does  it  compute  danger  contours  from  more  basic  information. 

These  functions  have  been  taken  as  "black  bon"  pieces  of  its  knowledge  base. 

In  the  initial  phases  of  this  research.) 

APS.  computes  the  Value,  or  "expected  utility,"  of  a  route  by  the 

following  formula j  based  on  Bayesian  decision  theory; 

Value  of  Route  -  (the  probability  of  arriving  at  and  damaging  the 
target)  x  (the  value  of  the  target)  -  (the  probability  of  ch-a 
aircraft  being  destroyed  anywhere  on  the  route)  X  (the  value  of  the 
aircraft) . 


This  equation  highlights  two  important  features  of  route  planning  nr 
replanning;  Cl)  two  major  uncertainties  must  he  considered t  the  probability 
of  damaging  the  target  and  the  probability  of  own  aircraft  destruction 
C lethality)  ;  hence ,  it  distinguishes  between  risks  on  the  ingress  and  risks 
associated  with  the  entire  route;  and  (2)  it  requites  a  comparison  between 
target  value  and  the  value  of  friendly  aircraft  .  In  essence,,  what  this  equa¬ 
tion  says  ia  that  for  a  route  to  be  acceptable,  the  chance  of  damaging  the 
target  (t.e.,  success  on  ingress)  and  the  value  of  the  target  must  be  great 
enough  to  outweigh  the  chance  of  being  destroyed. 

Tradeoffs  involving  these  factors  may  be  critical  in  route  replanning  when  a 
pop-up  threat  appears  during  the  Ingress.  For  example,  two  revised  route  op¬ 
tions  for  avoiding  a  pop-up  threat  may  be  available ¥  which  differ  in  how  they 
allocate  risk  between  ingress  and  egress,  Route  A  plays  It  safe  on  the 
ingress,  detouring  significantly  to  avoid  the  pop-up  threat;  but  on  egress  it 
oust  pass  quite  close  to  another  threat  due  to  fuel  constraints,  Route  B 
takes  a  mote  direct  path  to  the  target  than  Route  A,  placing  It  in  Jeopardy 
from  the  pop-up  threat,  but  leaving  it  with  enough  fuel  on  egfe-Ss  to  avoid  the 
other  throat.  It  might  be  that  Route  B  is  on  the  whole  safer  (t.e.,  has  a 
lower  total  lethality);  but  Route  A  might  be  preferable,  even  so,  because  it 
affords  a  better  chance  at  the  target.  According  to  this  model,  choice  be¬ 
tween  Route  A  and  Route  &  depends  on  hew  much  chance  of  damaging  the  target  Is 
worth  how  much  risk  to  own  aircraft.  The  present  system  takes  Such  tradeoffs 
into  account  (through  the  above  equation)  in  Its  evaluation  of  routes. 

The  Bayesian  approach  just  described  ignores  the  fact  that  Inferential  argu¬ 
ments  underlying  the  system's  evaluation  of  cendidats  routes  may  involve  vary¬ 
ing  degrees  of  unreliability.  As  a  result,  the  evidence  may  not  uniquely 
determine  an  evaluation  "score*  for  each  route  according  to  the  above  formula, 
Nevertheless ,  In  a  successful  rerouting  aid  the  potential  lethality  of  a  route 
to  own  aircraft  and  the  likely  damage  Inflicted  on  the  target  must  be  sum- 
njarir.ed  In  some  way;  different  routes  must  be  compared;  and  recommendations 
must  be  made  to  the  pilot  in  a  tiaely  fashion, 

ARE.  extends  the  traditions!  decision -theoretic  approach  to  accommodate  these 
requirements.  It  provides  two  lethality  measure*  lor  each  route;  a  Lower 
lethality  measure  representing  the  Lowest  danger-  consistent  with  the  evidence, 
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and  an  -upper  lethality  measure  representing  the  greatest  da-nger  consistent 
with  the  evidence.  These  measures  ate  computed  by  appropriately  tee 11 nesting 
■untoraraitSod  support.  1.*.,  support  assigned  to  subsets  of  hypotheses,  to  the 
elementary  hypOthc-ses  In  those  Subsets.  Similarly,  AER  provides  both  a  lover 
and  an  upper  measure  of  the  ohsnee  of  arriving  at  and  damaging  the  target.  By 
this  Ifeeens,  the  system  compueaa  an  Upper  and  a  lower  Value  for  each  routed 
The  upper  Value  Is  oh rained  by  utilizing  the  lower  measure  for  lethality  and 
the  upper  measure  for  damaging  the  target;  hente.  it  represents  the  most  op¬ 
timistic  assessment  of  the  route  that  Is  consistent  with  present  evidence, 

Thu  lower  value  is  obtained  by  utilising  the  upper  taeasur*  for  lethality  and 
the  lower  measure  for  damaging  the  target;  hence,  it  represents  the  most  pes¬ 
simistic  supportable  assessment. 

Determination  of  a  route  reecmaendatj cm  (From  a  set  of  previously  generated 
routes)  now  proceeds  in  Lwa  stages ;  (1)  If  the  lover  Value  measure  of  a  route 

Is  higher  than  the  upper  Vnlut  measure  for  another  rout*>  the  first  route  Is 
clearly  preferred  { find  is  recommended  by  our  system).  {2)  In  other  cases, 
however,  wheTe  the  Value  Intervals  for  different  mutes  overlap,  thu  evidence 
available  to  the  system  is  Insuffloi ant  fur  a  definitive  choice  {assuming  that 
all  cost-effective  information  collection  options  have  been  exhausted)  ,  In 
these  cases,,  the  system  utilize*  on*  of  two  normat ive iy  defensible.,  user- 
selected  "decision  attitudes*  to  determine  a  route  recoumendatloti .  According 
to  the  pussimixsi  {or  worst  case)  attitude,  upper  measures  are  used  for  the  bad 
outcome  {1,e_,  lethality)  and  lower  measures  are  used  for  the  good  outcome 
( i ,  e  .  ,  damaging  the  target).  According  to  the  conserve  t  Jl  m  attitude,  Values 
are  computed  utilizing  the  »bov*  equation  with  lower  measures  for  *11  outcomes 
(i.e.,  uncommitted  support  is  disregarded  rather  than  reallocated,  and  only 
what  the  evidence  positively  support*  1*  considered) . 

The  following  sections  describe  the  inference  Ecchanism  in  more  detail,  and 
present  sample  products  of  its  operation. 

k  . 1  The  JeLief  Functions 

ARE  begins  with,  prior  area  intelligence  about  threats  in  an  area  A  (for 
simplicity,  we  assume  A  to  b*  2 -dimensional  space).  This  Intel llgonoe  Is  rep¬ 
resented  as  a  belief  function  on  A,  En  route,  the  system  is  notified  of  new 
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evidence  of  a  threat  In  A,  again  expressed  as  a  belief  function  on  A,  ARft 
must  make  inferences  about  whether  the  second  iten  of  evidence-  represents  a 
new  threat  or  the  seme  threat,  and  if  the  aarae  threat!  whether  it  has  moved  to 
a  new  location. 

To  make  this  inference,  AJUt  first  extends  th*  two  belief  function*  to  the  set 
A  X  h  X  T,  where  the  two  copies  of  A  represent  the  system1*  knowledge  about 
thfc  two  threat  localizations,  and  T  «  (S,D)  is  Che  set  iMloatlng  whether  the 
two  signal*  represent  the  same  or  different  threats.  The  clement*  of  A  x  A  x 
T  are  interpreted  as  follows. 

(x,x,S)  ;  Same  threat,  unchanged  location  x, 

(x,y,3)  ;  Original  threat  at  x  haa  stove d  to  location  y . 

(x,y,D)  e  Different  threats  at  locationa  x.  and  y, 

Now  AEE  must  incorporate  its  prior  knowledge  about  whether  threats  are  likely 
to  move,  and  if  so,  how  far [  as  well  aa  its  knowledge  about  whether  there  are 
likely  to  be  gape  in  area  intelligence,  so  that  some  threats  may  have  heen 
missed;;  and  its  knowledge  about  the  typical  or  expected  spacing  of  separate 
threats.  Each  of  these  items  of  evidence  can  else  be  expressed  as  a  belief 
func  t ion  eve  r  A  x  A  X  T . 

H 

AES's  evidence  is  summarized  by  five  belief  functions,  described  below.  Table 
4-1  defines  formal  notation  for  the  fecal  elements  of  each  of  the  belief  func¬ 
tions  and  the  belief  assigned  to  each,  A  finite  number  of  focal  elements  is 
assumed  for  each  belief  function. 


Eel^i  Summarizes  prior  evidence  about  the  location  of  the  first  threat, 
Relief  la  focused  on  circles  of  increasing  radius  centered  at  ;ih . 
This  evidence  provides  no-  information  about  the  location  of  the 
second  (or  moved)  threat  or  about  whether  the  two  threats  are  the 
same  or  different. 

Eel  2  ■  Summarizes  evidence  about  the  location  of  the  second  threat. 

Belief  is  focused  on  circles  of  increasing  radius  centered  at  9^ ■ 
This  evidence  provides  no  Information  about  the  original  threat  or 
about  whether  the  two  threats  are  the  same  or  different, 

$L4mjna r i s-o-s  evidence  about  movement.  This  evidence  provides  no  In¬ 
formation  about  whether  the  two  threats  ate  the  sene  or  different, 
but  if  they  are  the  same*  there  is  evidence  about  whether  there 
was  movement  (e.g.,  observed  transport  activity)  and  if  so,  how 
much  (based  on  time  available  and  estimated  speed  capabilities). 
Thus,  belief  is  focused  on  the  diagonal  H  in  AxA  (threats  in  the 
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Belief  Function 

Focal  Element 

Belief  Asilgnnent 

B*lj 

S  (a. )  x  A  x  (S,D } 

1C  it 

n1  (x) 

O^fcO-U 

**2 

A  x  Sy(a2>  x  JS*D} 

m2(y> 

(Ern^fy) El} 

Bel. 

(H  x  {5)>U  (A  X  A  X  {D}) 

s 

J 

(Cw  x  {S»U(A  x  A  X  (D}) 

m.  £w> 

(&a3(w)-l-s> 

Bei 

A  x  A  <S} 

q 

'M 

A  x  A  x  (S*P} 

BeLs 

<H  x  {D})  1/  (A  x  A  x  ($» 

■Z 

(Ea^O-l) 

Definition  of  symbols; 

S-gUj)  -  U  ■  \*-*L\  <  *} 

Sy(*2*  "  4*  ;  la-a3l  1  ?} 

N  -  {(a*a)  i  ££A} 

Cv  =  l<a,b)  :  fs(w)£la-b|^f*<w)} 

(where  ft(w)  end  f*(w]  ore  lower  and  upper  bounds  for  the  distance 

range  of  the  set  C  ) 

w 

E?  -  Ua»t)  i  S*C=>  _<  |a— 1>  |  _<  B*  f*> 

(where  5^,(1)  and  g*(z}  ore  lower  and  upper  bounds  for  the  distance 
range  of  the  set  JS^  ) 


Table  4-1 1  Summary  of  Belief  Functions  for  Filot  Md 
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same  location)  ,  and  on  sets  Crj.,  each.  o£  the  as  rapes  a  anting  a  range 
of  distances  the  threat  might  have  aoved. 

Bel^:  Snremflf I 7p»  evidence  about  the  thoroughness  of  intelligence. 

Belief  la  focused  on.  subsets  of  T  (whether  the  threats  are  the 
same  or  different);  this  evidence  provides  no  evidence  about  loca¬ 
tion  or  separation  of  the  threats. 

Summarizes  evidence  about  the  separation  of  different  threats  (if 
threats  are  different,  they  are  likely  to  he  separated).  Belief 
is  focused  on  sets  B  t  each  of  these  representing  a  range  of  dis¬ 
tances  the  threats  might  be  separated.  This  belief  function 
provides  no  information  about  whether  the  threats  ate  the  sane  or 
different,  or  about  their  separation  in  case  they  a fa  the  sarte . 


These  five  belief  functions  may  be  combined  by  Dempster1 a  Rule  to  obtain  a 
belief  function  Bel*  over  A  x  A  je  T,  Table  4-2  summarizes  the  focal  elements 
of  the  combined  belief  function  and  the  belief  assigned  to  each.  The  belief 
function  Bel*  is  obtained  by  normalizing  these  belief  assignnents  (dividing  by 
i  sinus  the  total  belief  assigned  to  the  null  set).  The  steps  In  combining 
the  belief  functions  are  summarized  below. 


1.  Combine  Beln  and  to  obtain  a  new  belief  function  with  focal 

■elements  S  ,D) ,  each  with  belief  (y ) , 

2.  Combine  Bclj  and  Bclg  to  obtain  a  new  belief  function  with  fecal 

element*  &)  D>  >  (belief  sn^Cz))  and 

(belief  aj(v)lj(E)).  The  first  type  of  focal  element  represents  the 
belief  that  If  the  threats  are  the  same,  there  Is  no  noVement ; 
otherwise,  their  separation  is  described  by  the  range  of  distances 
represented  by  B  .  The  second  type  of  focal  element  represents  the 
belief  that  if  there  is  movement,  it  is  represented  by  Ctf-  if  the 
threats  ate  different,  separation  is  described  by  B£. 

1.  Combining  the  results  of  Steps  1  and  2  gives  a  belief  function 
with  two  typee  of  focal  element,  The  first  type  of  focal 
element  is  [{^(a^xS  (a^)  ttHxlS)  J  [(S^fa^xS (a2)  )nB„x(D)  ] 
representing  belief  ih  a  single  threat  unmoved,  or  a  different 
threat.  The  second  type  of  focal  element  is 

[  (fl  (a^itS^ajJ^C^xlSll  [{ 5^ ) x5  ( a2)  )r\ B^x [ D >  ]  ,  representing 
belief  in  a  moved  or  a  different  threat, 

■4.  The  final  step  ia  to  add  in  Bel^+  the  belief  in  a  single  threat. 

The  result  is  the  sane  focal  elements  as  in  3  (representing  the  un¬ 
committed  belief),  as  well  as  the  focal  elements  E,t (aj)flHKE  S  ] 
and,  £^(ai  )KS„(ao)r)Cux(  S)  ,  representing  belief  in  a  single^  threat 
with  unchanged  location  or  with  location  change  -described  by  Cv . 


CO  3t  S  (a  *  )  B 


rabL*  4-2a  Ciimbtned  fielief  AnaignmenEa. 


s^moflfevv 


Table  4~2 c ;  Coabined  Belief  Assigrinente 


Foc-sl  Element, 

Belief  (xnn-'iiaraallMd) 

Condition 

Belief  AsbigranenE 
(U=unch.anRed»  H'Toaved,.  B^dlffere 

©  (fl^ncj  x{s} 

1 

S^Cb^JA  Sy(*p  f  0 

U.M 

(Baiue  but  UCC  ) 

w 

sy(a2)  -  $ 

W  x  sy(fl25/1  Cw  *  11 

H 

W^W^S,"  “ 

« 

i 


A  belief  function  over  the  three  possibilities  unchanged  (U)  ,  moved  (M)  ,  and 
different  (10  can  be  defined  by  the  marginal  belief  function  of  Bel*,  table 
4-3  gives  this  marginal  belief  function. 


Table  h-l  presents  quite  complex  Bathcmetical  conditions  for  belief  in  the 
three  hypotheses  (unchanged,  soved,  different}  and  their  various  comb ins Cions, 
These  conditions  eat;  be  greatly  Illuminated  by  describing  them  verbally  in 
terms  cf  reasons  for  belief  in  the  hypotheses. 


*  Contours ‘  degree  of  overlap  -  The  threat  can  be  unchanged  only  if 
it  is  possible  that  the  two  signals  could  have  come  from  the  same 
location.  Thus,  belief  in  an  unchanged  threat  is  supported  to  the 
degree  that  the  location  contours  of  Bel^  and  BoLj  overlap. 

*  Distance:  possibility  of  jiotftasjit  -  .Movement  fe  possible  only  if  hen 
the  separation  between  the  throats  (described  by  fioi  ^  and  Belj)  is 
consistent  with  the  distance  a  threat  might  hsvs  moved  (as  described 
by  the  distance  tangos  of  Bel-j) ,  Thus f  belief  in  a  moved  threat  is 
supported  to  Che  extent  that  the  contours  of  Bel^  and  Belj  are  con¬ 
sistent  with  the  distance  ranges  of  Bel^. 

*  Likelihood  of  movement  -  Belj  also  has  a  focal  element  representing 
positive  belief  in  no  movement.  Belief  in  movement  is  supported  to 
the  extent  that  this  focal  element  has  low  belief, 

*  Distanced  possibility  for  different  threats  -  Different  threats  are 
possible  only  when  the  threat  separation  (described  by  Bel^  and 
Ee^)  is  consistent  with  threat  spacing  information  (described  by 

Fin  1^} .  Thus,  belief  in  different  threats  is  supported  to  the  extent 
that  the  contours  of  Bcl^  and  Belj  are  consistent  with  the  distance 
ranges  of  Eel^. 

*  Threat  -coverage  -  The  threats  can  be  different  only  if  it  is  pcs - 
sibls  that  a  threat  was  missed.  Thus,  belief  in  different  threats 
is  supported  by  a  low  belief  in  the  thoroughness  of  intelligence  (as 
described  by 


The  system  has  the  capability  for  selecting  which  of  the  above  reasons 
provides  primary  support  either  for  or  against  each  of  the  hypotheses,  Tlia 
display  info rns  the  user,  then,  not  only  of  the  belief  in  each  hypothesis,  but 
of  the  reasons  supporting  that  belief. 
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Table  4-3:  Karginal  Belief  Function  ever  Etf,H3Df 


Focal  Element 

Belief 

(U> 

mi 

B+L*(Kx(Sn  sT' 

ID* 

B*i*(AxAx{D)) 

ttf.K) 

ad*(AaAx(51  ) 

eu7dj 

Eelt{AiAxlD))  +  B*lt(lbtlS)) 

E*1*<AXAX{D>)  +  Bel+(tfatlS)) 

(W.x.p) 

1 

4,5  fignKlss  Rmlmlaii 

Vo  sec  fren,  Table  4-1  that  combining  belief  functions  -with  mass  focused  on  in- 
compatible  subsets  results  in  belief  Oielgntd  to  She  Hull  set,  We  use  as  a 
measure  of  conflict  the  amount  ef  belief  assigned  CO  th*  null  set  when  apply¬ 
ing  E-empa tar's  Rule.  This  is  the  measure  of  conflict  used  by  &hafet  (1976) 
aryl  by  Cohen  {19B5J  . 

Slewed  in  another  way,  conflict  occurs  to  the  extent  that  there  is  evidence 
ag-aiuft  all  three  hypotheses  (unchanged,  moved,  different).  For  each  of  the 
six  null-set  entries  in  Table  4-1,  we  cat  identify  the  reasons  for  the  ■occur¬ 
rence  Of  the  tonfliecf  in  terms  of  tho  taKorony  given  at  the  end  of  the  pre¬ 
vious  section,  Table  4-4  gives  the  reasons  £or  Che  six  types  of  conflict. 

For  example,  the  first  type  of  conflict  occurs  to  the  extent  that  belief  is 
assigned  to  non- overlapping  contours,  to  non ■ movement ,  and  to  distance  ranges 
incompatible  with  location  contour f , 


When  combination  of  the  five  belief  functions  results  in  conflict  greater  than 
threshold  tc,  the  systems  conflict  resolution  procedure  Is  invoked,  The  con¬ 
flict  resolution  procedure  is,  in  effect,  a  mechanism  for  searching,  within  the 
arguments  leading  to  each  of  the  five  belief  functions  in  an  EiftcEpt  to  ideti" 

mJ^X  [j  J.jj. --  C 

tify  potential  weakness**  in  the  argonauts.  WhcTysuth  Weaknesses  -ace  " 

■identified,  cb*  corresponding  belief  functions  are  discounted,  leading  to 
reduction  in  conflict.  As  long  as  potential  weaknesses  tan  be  identified,  the 
process  Of  conflict  resolution  continue e  until  conflict  ia  reduced  to  below 
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CONFLICT  TYPE 
t From  Table 

4-6} 

CONTOUR 

NON- 

QVERLAF 

DISTANCE 

PRECLUDES 

MOVEMENT 

EVIDENCE 

FOR  MOVE¬ 
MENT  (if 
same  threat} 

EVIDENCE 

AGAINST 

MOVEMENT 

DISTANCE 

PRECLUDES 

DIFFERENT 

COVERAGE. 

coon 

(1) 

X 

X 

X 

(2) 

X 

X 

X 

<3> 

X 

X 

X 

(4) 

X 

X 

X 

C5) 

X 

X 

X 

C6> 

K 

X 

X 

Table  4-4-:  Reasons  for  Conti  Id  G-  -  S  i  x  Typos  of  Conflict 

Ajs  Indicated  in  figure  3-1,  each  belief  function  ha*  associated  with  it  m  Set 
Of  potential  discount  factor* ,  or  factors  inf loanting  die  reliability  of  the 
link  between  the  evidence  and  the  conclusion.  An  example  of  such  a  dlsoovTit 
factor  would  be  the  presence  of  ECU.  itl  the  area  when  A  SA.R  signal  is  observed: 
such  presence  would  tend  to  discredit  the  location  estimate  derived  fr™  tha 
5AR  signal. 

Each  discount  factor  has  associated  with  it  an  initial  belief  function.  Ibis 
function  represents  the  "default"'  assumption  the  system  wishes  to  make  about 
the  presence  of  the  factor,  prior  to  testing  for  its  presence,  A  reasonable 
initial  belief  function  might  be  vacuous,  aa signing  all  belief  to  thE  univer¬ 
sal  sett  and  th.ua  representing  no  information  about  the  factor’s  presence  or 
absence,  Alternatively,  there  might  be  evidence  available  initially,  whether 
specific  to  this  mission,  or  baaed  on  prior  experience.  The  initial  belief 
function  allows  such  information  to  be  incorporated  into  the  analysis. 

Each  discount  factor  also  has  an  associated  cast  for  factor  presence,  The 
teat  DL*y  have  several  possible  outcomes.  Each  teat  outcoiae  o  is  associated 
with  *  belief  function  which  summarizes  the  impact  of  observing  test  outcome  o 
on  belief  in  factor  presence.  If  s  test  is  performed  with  outcome  o,  the  as¬ 
sociated  belief  function  is  combined  via  Dempster**  Rule  with  the  initial 
belief  function  to  obtain  an  updated  belief  function  for  factor  presence. 
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Belief  functions  are  discounted  according  to  the  amount  of  belief  directly 
committed  to  factor  presence.  (This  practice  corresponds  to  an  as sumption 
that  the  evidential  link  le  valid  until  evidence  is  observed  to  the  contrary.) 
If  is  the  amount  of  belief  directly  committed  to  the  presence  of  discount 
factor  k,  then  the  discount  rate  for  the  corresponding  belief  Function  te: 

/- 

3  -E 

l 

where  the  summation  1$  over  thote  discount  factors  associated  with  the  given 
belief  function.  The  number  w^  Is  a  measure  of  the  impact  of  tha  presence  of 
factor  k.  on  the  discounting,  The  are  assumed  to  be  positive  and  to  sum  to 
1,  The  resulting  discount  rate  ranges  between  Q  and  1,  with  a  discount  race 
of  0  corresponding  to  complete  discrediting  of  the  evidential  link,  And  a  dis¬ 
count  rate  of  1  corresponding  to  no  discounting  relative  to  the  initial  belief 
function. 

The  belief  function  fcel^  It  discounted  by  multiplying  thn  belief  assoclecad 
with  eath  focal  element  by  the  discount  rate  This  reeulti  in  beliefs  Surt' 
ning  te  less  than  1;  belief  I  a  oner  added  to  the  universal  set  t&  correspond  to 
the  belief  subtracted  from  each  of  the  focal  elements, 

Wham  the  initial  belief  functions  for  some  of  the  discount  factors  for  Bel^ 
dte  non -■ vacuous ,  the  *y*tew  discount  belief  function  Bel^  before  initial 

application  of  Dempster 4 s  Rxiio  (described  in  Section  2.2.2),  Thug,  the  ini¬ 
tial  pass  of  the  inference  mechanism  Incorporates  any  discounting  deemed  ap¬ 
propriate  prior  to  combination  of  tbs  evidence. 

We  now  describe  the  process  Initiated  when  comb inat ton  of  initial  belief  func¬ 
tions  (which  incorporate  the  initial  discount  rates)  results  in  conflict  ex¬ 
ceeding  tbit  threshold  ,  AML  moves  to  the  *  second  pass*  of  its  Inference 
mechanism,  described  by  Che  following  five  steps, 

1.  Decide  which  discount  factor  for  which  belief  function  is  the 
provisional  "culprit"  and  which  tost  to  perform  on  the  culprit, 

(This  step  is  the  crux  of  the  algorithm  and  the  selection  criteria 
are  discussed  in  detail  below.)  If  no  culprit  can  be  found,  initiate 
Pfi*a  3, 
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Perform  the  teat  and  revise  belief  in  Che  appropriate  di at  wanting 
fat tor . 

J.  Compute  a  revised  discount  rate  and  apply  It  to  the  culprit  belief 
function,  resulting,  in  a  new  belief  function, 

4,  Racomfaine  the  belief  functions  according  to  Hemps  ter 'a  Rule,  as 
described  In  Section  2.2,2.  The  result  is  a  new  combined  belief 
function,  and  a  new  measure  of  conflict, 

5,  If  conflict  la  below  tr. ,  stop.  Otherwise,  return  to  Step  1, 

The  teat  chosen  la  baaed  on  potential  for  conflict  reduction,  balanced  against 
the  cost  of  performing  the  test. 

Each  test,  then,  must  have  a  coat  associated  with  It,  It  is  in  these  ee&tfc 
that  a  crucial  difference  between  ground-baaed  and  In-flight  aids  comes,  to  the 
lore.  Ail  in-flight  aid  would  associate  a  very  high  cost  with  performing  any 
test  for  which  results  could  not  be  obtained  very  quietly.  Moreover,  the 
costs  might  change  dynamically  with  flight  progress  {sots  tests  being  feasible 
early  on  when  the  time  Stress  is  not  so  great,  hut  becoming  infeasible  later 
in  the  mission). 

To  decide  which  teat  to  perform,  our  prototype  ays tern  fir at  evaluates  each 
test  to  see  which  has  the  maximum  potential  for  conflict  reduction.  To  do 
this,  the  system  computes  a  measure  of  the  Impact  of  discounting  each  of  the 
component  beliof  functions  on  conflict  (a  partial  derivative  of  conflict  with 
respect  to  the  discount  rate  on  the  component  belief  function).  It  then  iden¬ 
tifies  for  each  test  associated  with  each  belief  function  the  maximum  poten¬ 
tial  for  discounting  the  associated  belief  function  {taken  over  all  teat 
results).  This  maximum  discount  rate  is  multiplied  by  the  partial  derivative 
to  obtain  a  measure  of  the  maximum  possible  Impact  on  conflict  for  the  given 
test.  This  quantity  is  then  divided  by  cost  to  obtain  a  measure  of  maximum 
conflict  reduction  per  unit  cost.  The  test  is  chosen  for  which  this  measure 
is  the  highest,  CHete  that  there  Is  no  guarantee  that  conflict  reduction  will 
be  as  great  as  indicated  by  this  measure  ■- the  measure  is  based  on  the  most 
favorable  result  for  the  test,  which  may  not  be  the  result  observed.) 

Formally,  lot  5^  be  the  initial  discount  rate  for  belief  function  I,  and  let  c 
be  the  Conflict  computed  under  discount  rate  (L.e,t  the  conflict  from.  Pass 


1  of  the  algorithm) ,  Let  Cj  be  the  partial  derivative  of  c  with  respect  to 
£  j  _  How,  far  a  given  test  tt  let  he  the  maximum  discount  rate  (over  all 

test  results)  that  can  be  obtained  for  that  test.  Now,  for  each  discount  fac¬ 
tor  t,  lEt  t<£>  be  the  test  for  factor  presence,  i({t(£))  the  cost  of  the  test, 
and  t(£)  the  index  of  the  associated  belief  function.  Then  let 

u(f)  - 

tbft  quantity  u(f)  can  be  thought  of  as  ths  utility  of  t(*clftg  fox  discount 
fas tor  f  (the  negative  sign  occurs  because  conflict  varies  inversely  with  dis¬ 
count  rate) h 

The  test  t(f)  Is  performed  for  the  factor  f  for  which  u{ f )  is  maximized. 

Even  In  the  face  of  extreme  conflict,  discounting  s  centr Lbc-ting  argument  may 
not  be  appropriate.  There  must  be  a  reasonably  strong  case  that  the  most 
likely  cause  (or  causes)  of  the  conflict  have  been,  identified.  It  may  be  the 
case  that  the  system  cannot  find  a  test  to  perform,  whether  because  no  test 
has  the  potential  far  significant  conflict  reduction,  because  all  tests  cost 
too  much  to  perform,  or  because  all  possible  tests  have  already  been 
performed*  We  saw  above  that  In  this  case,  the  system  resorts  to  a  third  pass 
of  -discounting  all  belief  functions,  according  to  a  formula  by  which  those 
belief  functions  contributing  most  to  the  conflict  ate  discounted  the  most. 

The  mechanism  for  this  across-the-board  discounting  is  quite  a  natural  exten¬ 
sion  of  the  present  framework  for  representing  evidential  reasoning.  Each 
evidential  argument  is  associated  with  a  discount  factor  called  "conflict  with 
other  evidence,"  Across-the-board  discounting  involves  an  increase  in  the 
belief  in  the  presence  of  this  factor,  proportional  to  the  contribution  of  a 
given  argument  to  the  conflict.  The  weight  on  this  factor,  for  a  given 
argument,  reflects  the  firmness  with  which  the  system  will  retain  commitment 
to  that  particular  evidential  link  in  the  face  of  conflicting  data, 

UA  Sample  Results 

In  this  section „  we  describe  some  cf  the  results  produced  by  app Lying  thn  in- 
ference  ■eohatiisms  within  our  prototype  system  to  samp le  data,  Wo  stress  that 
the  following  discussion  ia  not  meant  as  a  description  of  the  user -system 
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Inttrfocei  thcsa  rtsult?  uquW  ebviwsly  not  *11  bo  presented  to  users  In  this 

form  (*<*  Section  A, 5  below). 

Figures  4-1*  through  4-le  illustrate  the  output  of  Pass  1  through  th*  system's 
ifrftrtft o*  mechanise^  for  each  of  fi.v«  different  inputs,  Each  of  those  figures 
the  Input  belief  functions,  the  combined  threat  classification 
be Lint  function,  and  the  Ooouiit  of  conflict  in  the  evidence. 

In  the  first  analysis  (Figure  4 -la}.,  belief  contour b  fox  the  first  and-  second 
threats  are  centered  at  a  distance  of  5  units  (say,  miles}  apart.  The  loca¬ 
tion  contours  describe  hciw  certain  we  are  of  these  localisations .  Thus,  for 
the  first  localisation,  there  is  belief  of  .1-0  that  the  tateat  lies  within  ,93 
units  of  the  center  (2,2).  Hie re  ia  belief  .54  ( ,  14  +  .14  +  .16}  that  the 
threat  lies  Within  1.5  units  of  (2,2}.  We  see  that  the  localization  of  the 
second  threat  Is  less  precise  than  that  of  the  first- -the  belief  contours  have 
greater  radius.  Belief  Of  .3  is  committed  -directly  to  the  hypothesis  that  the 
se-cond  threat,  if  the  same,  has  not  moved;  belief  of  .10  is  uncommitted  about 
whether  or  hew  far  it  moved,  and  the  rest  of  the  belief  is  distributed  across 
nested  interval*  of  distances  the  threat  may  have  moved.  Belief  of  ,7  has 
been  be signed  to  the  second  localisation  representing  the  same  threat  as  the 
first  (indicating  fairly  high  confidence  in.  area  intelligence}.  Finally,  if 
the  threat  has  movod,  WO  place  belief  ,17  on  its  having  moved  at  least  6.1 
miles,  and  belief  .  (.17  +  ,17  ■+■  ,17  +  .17)  on  itB  having  moved  at.  least  3.2 

milts . 

The  resulting  belief  function  places  the  highest  weight  on  the  hypothesis  of  a 
single  threat  that  has  moved.  This  result  is  consistent  with  our  confidence 
In  area  intelligence,  as  veil  as  a  small  amount  of  belief  placed  on  the 
threats  being  the  same.  Conflict  is  not  too  large,  at  a  level  of  ,17,  (We 
have  tentatively  adopted  a  conflict  threshold  of  .25  for  initiation  of  Pass  2; 
more  experience  is  needed  to  determine  vh*t  level  Is  best  in  this 
application, ) 

The  second  sot  of  inputs  (Figure  4- lb}  Is  the  same  as  the  first,  except  that 
the  belief  assigned  to  an  unmoved  threat  haa  been  raised  from  .3  to  ,7,  with 
corre aponding  reductions  In  belief  for  the  intervale  the  threat  might  have 
moved.  The  result  is  what  we  would  expect:  relative  to  the  first  set  of 
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iBgttfc  Belief  Functions : 


Center  of  Contours  -  <2 ,2) 


Radius 

.44 

.93 

1.5 

2,2 

3.3 

5.0 

Committed  Belief 

♦  18 

.19 

,18 

,18 

.18 

.10 

Be  lg  f 

Center  of  Contour a 

-  (5,6} 

Radius 

1.9 

3,9 

4,3 

6,6 

10,0 

Committed  Belief 

.16 

,ia 

.16 

.13 

.16 

.10 

Belji 

Belief  A&signcd  to  Diagonal  -  0, 

3 

Lover  Distance 

1.02 

,68 

.75 

.63 

0.0 

Upper  Distance 

1.34 

1.53 

1.76 

2.14 

Committed  Belief 

,15 

.15 

,15 

,15 

.10 

Bel43 

Belief  Assigned  to 

Same  Threat  — 

0.7 

Rp-15; 

Lover  Distance 

6.1 

4.9 

4.0 

3,2 

2.6 

2.0 

Upper  Distance 

in 

GO 

Ob- 

TO 

Committed  Belief 

,17 

.17 

.17 

.17 

.17 

.15 

Combine  d  Belief  function; _ Classification  of  Second  Threat 

{U  -  unchanged;  H  -  moved;  D  —  different) 


6el*<|U}}  -  .15 

Bel*UU,«l) 

-  .63 

-  .43 

-  .11 

Bel*(iDj)  «  .09 

Bel*({H0D}) 

-  ,71 

Be!*t(U,H,Dn 

-  1.0 

Conflict  fMnss  Assigned  tojftill  Setl  In  OoTafrlnnd  Belief  Function  -  ,17 


Figure  4-U:  Output  of  Pass  1  of  Inference  Mechanism 
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mp-ut  Belief  Functional 


: 

Center  of  Contours 

- 

EtAdllU 

.44 

.93 

1.5 

2,2 

3,3 

5.0 

Coriditted  Belief 

.18 

,18 

,18 

.18 

,18 

,10 

Bcl^: 

Center  p£  Contours 

-  <5,63 

Radius 

.88 

1.9 

3,9 

10,0 

Committed  Belief 

,18 

,xs 

,18 

,18 

.16 

.10 

&ol3- 

Belief  Assigned  to 

Diagonal  -  Q . 

7 

Lover  Distance 

i.oa 

.88 

.75 

.63 

0,0 

Upper  Distance 

1,34 

1.53 

1,7ft 

2.14 

u> 

Commit ted  Belief 

.05 

.05 

,05 

,05 

.10 

Bel^: 

Belief  Assigned  to 

Same  Threat  — 

0,7 

Bel^I 

Lower  Distance 

6.1 

4,9 

4.0 

3,2 

2.6 

2.0 

Upper  Distance 

CD 

a>.' 

DO 

«a 

D0 

Committed  Belief 

.11 

.17 

.17 

,17 

,17 

.15 

Contained  Bfcltef  Function- _ Olaaslff icatlnn  of  Second  T Wat 

{U  -  unchanged;  M  -  woved;  D  -  different) 


Eel*(lUO  -  ,3ft 
Bel*({H!)  *  ,1ft 
BeLfrUEJ)  -  ,12 


fecl+UU.Hn  -  .61 

Bel*(HJdDJ)  -  ,66 

Bel*{[H+D)>  -  ,38 

Bel*((DtMhDn  -1.0 


Conflict  fjjm  Aligned  to  Null  Set)  In  Combined  Belief  Function  -  ,22 


Figure  4_ik; 


Output  of  PaJjs  1  t*f  Inference  Mechanism 
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Input  Belief  Function*: 


Bell  1  Center  of  Contours 

“  <2,25 

Radius 

,44  .93 

1.5 

i.i 

3.3 

5.0 

Coziniitted  Belief 

,1*  >18 

,18 

.18 

.16 

.10 

Bel  2'  Center  of  Contours 

-  (3,4J 

Radius 

,0S  1,9 

3.9 

4,3 

6.8 

10.0 

Connltted  Relief 

,js  ,n 

.18 

.18 

,18 

.10 

Belli  Belief  Assigned  to 

Diagonal  *-  0  . 

7 

Lower  Distance 

1.02  .Be 

.75 

.63 

0.0 

Upper  Distance 

1,34  1,53 

1.76 

2-14 

Committed  Belief 

,05  ,05 

.05 

,05 

,10 

Bel4;  Belief  Assigned  to 

Sene  Threat  « 

0  r7 

Bel^i  Lower  Distance 

6  rl  4.9 

4.0 

3.2 

2,6 

2,0 

Upper  Distance 

W  DO 

uu- 

DC- 

CP 

rri 

Committed  Belief 

.17  .17 

.17 

.17 

,17 

.13 

Eanfeliad-Billal  fmKcl°n- _ c usfcifite.uan ^Uttaad  Threat 

<U  —  unchtngtd;  H  ■  novtd;  D  “  difftrut) 


Bel+< iU] 3  - 

.46 

Bcl*< {U , M} ) 

-  .70 

Bel#CEH}>  - 

.15 

Bel*<(UrDl]) 

-  .69 

Bel+<(D})  - 

.01 

Bel+(tH,DS> 

-  .22 

Bel*<lU,H,BD 

-  1.0 

Conflict  Qtasa^Msigned  tE.  Hull  Set3  in  CornMne-d  Belief  Tunctliyn. 


Figure  4-lc  ; 


Output  of  Faae  1  of  Inference  Meehan ism 


iTVjrut  Belief  Tnfictlppat 


BeJ^i  Center  of  Contours 

-  Ci.2) 

EUdiu* 

.44  .93 

1.3 

2.2 

3.3 

5.0 

CMmiited  Relief 

.19  .18 

.18 

.18 

.  18 

.10 

Bcl^'  Center  of  Contours 

“  <&,&) 

Radius 

,S8  1.9 

3.9 

4.3 

8.8 

10.0 

Coamitted  Belief 

.la  +1B 

IS 

.ie 

.ia 

.10 

Belj;  Belief  Assigned  to 

Diagonal  -*  Q. 

3 

Lower  Distance 

1.02  .88 

.75 

.83 

0.0 

Upper  Distance 

1.14  1.53 

1,  je 

2.14 

raj 

Committed  Belief 

.15  .15 

.15 

.15 

.10 

ftel^:  Belief  Assigned  to 

Same  Threat  — 

0,3 

Bel^;  Lover  Distance 

6,1  4,9 

4,0 

3.2 

2-6 

2.0 

Upper  Distance 

■>j  KJU 

DO 

■UU 

aa 

Committed  Belief 

,17  ,17 

.17 

.17 

.17 

,13 

gflafcimOrii+iE  mg*lai^-Cl*«UlE**  t™.  qf  Second  Thr-*^ 

(0  “  unchanged 1  H  “  moved;  D  “  different) 


Bel*{{V))  -  M 
Bal#<lK|)  -  .11 
Sel*{(D]>  -  .SI 


Bel*((U,K})  -  .14 
Bel*([V.DJ)  -  .59 
Bel*([H.D>)  -  .89 
Bel^UU.H.Dl)  -  l.Q 


Conflict  fKflBB  Assigned  to  Hull  Stt)  In  ferafelcissi  Belief  Function. 


Figure  Output  &f  BaSS  1  of  Inference  Mechanism 


IttEttfc-lfcliif  Emrctlonst 


Bel  l : 

C*nte¥  of  Oo-vi t ou tf 3 

-  (2.a> 

Radius 

.44  ,93 

1,5 

2,2 

3,3 

5.0 

Committed  Belief 

.is  .la 

IS 

.11 

,18 

.10 

ftela: 

Center  of  Contours 

-  (3,8) 

Radius 

,  BB  1,9 

3.9 

4,3 

6,6 

10,0 

Committed  Belief 

.10  .IS 

.13 

.IB 

,18 

.10 

Belj ; 

Belief  Assigned  to 

Diagonal  —  0. 

3 

Lover  Distance 

1.02  .38 

,73 

.63 

0.0 

Upper  Distance 

1,34  1,53 

1,70 

2,14 

m 

Committed  Belief 

,15  ,15 

.15 

,15 

,10 

E*l4i 

Belief  Ajssl^Eied  CO 

Sana  Threat  - 

0.7 

3c  L=  : 

LdVtr  Distance 

6.1  4.9 

4.0 

3.2 

2.6 

2.0 

Upper  Distance 

00  EH 

05 

■SB 

«l 

Committed  Belief 

.1?  ,17 

.17 

.17 

- 17 

.16 

Combined  Belief  Function: _ Class If ica t i on  of  Second  Threat 


{V  - 

unchanged; 

K  -  moved;  p  - 

differetit) 

B*i,am  > 

-  .08 

-  .49 

Bti+anj) 

-  .38 

Bel*^U,01) 

-  .42 

Beuaon 

-  .31 

-  .85 

BeMlU,M,D))  -1,0 


to  thill  Sstl  lRJkjmklnadLJalisf JmEttan 


FiguT*  4-le:  Output  of  Pass  1  of  Inference  Kcchanisui 


Inputs,  belief  assigned  to  an  unchanged  threat  has  increased,  and  belief  in  a 
moved  threat  has  decreased.  Conflict  has  increased  a  little,  and  ia  new  near 
the-  threshold  for  initiation  of  Pas  a  2,  This  rs  fie  eta  the  fact  that  the  over¬ 
lap  in  the  location  contours  is  little  enough  that  there  is  reasonable  con¬ 
flict  in  attributing  both,  to  an  unmoved  threat, 

Kow  consider  a  third  set  of  inputs  identical  to  the  second,  except  that  the 
centers  of  the  contours  move  eloeer  together  (Figure  4-lc)  ,  As  expected, 
belief  in  an  unchanged  threat  is  greatly  increased  relative  to  that  in  a  moved 
threat.  .Moreover,  conflict  has  decreased  to  nearly  zero,  indicating  the  ex¬ 
tent  to  which  the  conflict  in  the  second  set  of  belief  functions  was  due  to 
non - overlapp ing  c  ontour  s . 

The  fourth  set  of  inputs  (Figure  A- Id)  ia  the  same  as  the  first,  except  that 
the  centers  of  the  location  contours  are  now  farther  apart,  and  belief  in  the 
thoroughness  of  area  intelligence  has  decreased  to  O.i  (indicating  a  fairly 
high  possibility  that  a  threat  may  have  been  overlooked).  The  result  is  a 
high  belief  in  the  two  localizations  representing  different  threats,  The  con¬ 
flict  level,  .19,  is  not  sufficiently  high  to  trigger  conflict  reduction. 

Our  final  example  (Figure  4-le)  illustrates  what  happens  when  the  threat 
localizations  remain  widely  separated,  hut  confidence  in  area  Intel! t gene e  is 
raised  again  to  ,7,  The  combined  belief  functions  assign  nearly  equal  weight 
to  moved  and  different  threats  (the  overlap  in  the  contours  he ing  small  enough 
that  very  little  belief  is  assigned  to  an  unchanged  threat)  .  But  most 
importantly,  conflict  is  greatly  increased;  nearly  half  of  the  belief  in  the 
combined  functions  is  assigned  to  the  null  set.  This  set  of  Inputs  results  in 
triggering  of  Pass  2,  the  conflict  reduction  step. 

In  Pass  2,  our  system  first  chooses  to  teat  for  the  presence  of  E-CM  In.  the 
area.  The  result  is  a  discounting  of  the  belief  contours  of  Belj  by  a  dis¬ 
count  rote  of  -31.  After  discounting,  Dempster 1  a  Stale  is  reapplied  (Figure  4- 
2),  and  the  new  level  of  conflict  Is  greatly  reduced  to  0,29.  This  level 
remains  above  the  threshold  of  ,29,  *  second  pass  of  conflict  reduction  is 

initiated.  The  system  next  chooses  to  reassess:  the  thorough^***  of  area 
intelligence.  It  searches  for  Information  about  otto  Intelligence  (uhachar 
from  the  pilot  or  by  querying  ground ‘based  sources) ,  and  decides  to  discount 


3ei^  by  a  disc aunt  fata  of  ,15*  After  this  final  -discountings  conflict  la 
reduced  to  an  acceptable  .23.  Figure  h  +  2  reports  the  system's  inferencea 
about  threat  classification.,  Host  of  the  mass  has  been  allocated  to  a  com*- 
blnatlon  of  the  hypotheses  that  the  threat  has  moved  or  is  different  (total 
mass  .76  in  the  final  pass) . 

Relative  to  Figure  4- Id,  there  is  a  higher  degree  of  belief  that  the  threat 
has  moved.  This  is  because  the  high  confidence  in  area  Intelligence  tends  to 
discredit  the  hypothesis  of  different  threats.  Note  that  the  final  pass,  in 
discounting  Bel ..,  has  resulted  In  decreased  confidence  in  area  intelligence 
(.7  la  discounted  to  (L-..L9)  x  .  7  -  . 57 )r  This  results  in  higher  belief  in 
different  threats  after  the  final  pass  than  on  the  previous  paas„ 

In  summary,  we  aee  that  the  numerical  results  in  the  examples  given  conform  to 
intuition.  Increasing  initial  belief  in  an  unchanged  threat  increases  con¬ 
flict  to  the  extent  that  contours  do  not  overlap,  and  alao  increases  final 
belief  in  an  unchanged  threat.  Hoving  the  signals  closer  together  increases 
final  belief  in  an  unchanged  threat;  moving  them  far  apart  increases  belief  in 
different  threats.  Incompatible  initial  beliefs  (threats  far  apart  but  missed 
threat,  unlikely)  results  in  conflict,,  which  is  resolved  by  discounting. 

4.5  Hardware 

In  the  interests  of  efficiency  of  coding  and  portability,  the  demonstration 
system  Is  implemented  in  the  C  language  on  an  IBM  AT  with  an  30287 
coprocessor,  at  least  512KE  of  random  access  memory,  and  IBM  Enhanced  Graphics 
Adaptor  (640  e  360  pixels  with  18  aimil taneous  colors),  and  IBM  Enhanced 
Graphics  monitor,,  and  a  mouse  input  device.  The  mouse,  though  clearly  inap¬ 
propriate  as  a.  cockpit  Instrument,  should  provide  an  adequate  functional 
simulation  for  demonstration  purposes  of  other  "pointing"  input  modes,  such  as 
eye  movements,  A  fully  function  cockpit  hardware  co-tlf i gurAtion  is  likely  to 
differ  in  other  respects  as  required  by  the  cockpit  environment. 
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Pirs-t  Conflict  Resolution  ?e£t; 


Classification  of  Second  threat 


-  ,14  BbL^LU.M})  -  ,56 

-  ,40  -  .37 

Bcl*{(U}>  -  .17  Eel*{tH,DO  -  .74 

Bei*< [tpH,D} >  -  1.0 

Conflict  in  Assigned  Belief  Function  -  ,29 

Second  Conflict  Resolution  Easa: 

Classification  of  Second  Threat 

fial^LU))  -  ,10  B«a^((0hH)>  -  ,43 

Bel*(milJ  -  .30  BaI*(flT(D|)  *  ,41 

Bel#({Dl)  -  .23  Bel^C [HPE})  -  ,7* 

-  1.0 

Conflict  in  Assigned  Balitf  Function  -  ,23 


Figure  4' 2:  Output  Of  Pats  2  of  Inference  tfeohanisn 


5rQ  HUNAN  COMPUTER  INTERFACE  FOR  THE  ADAPTIVE  ROUTE  REPLANNING  AID 


3 -l  Basic:  Approach 

The  user  computer  interface  for  an  effective  inflight  rerouting  aid  must 
successfully  balance  a  set  of  coupe  ting,  objectives:  it  must  (a)  minim  ite 
demands  on  user  time  and  effort,  while  at  the  same  time  (h)  communicating,  both 
recooiendations  and  reasons  for  those  recommendations  in  a  way  which  maximises 
user  understanding,,  and  (cj  permitting  rap  id  ,  effective  user  input:  where  they 
might  be  critical  for  mission  success.  * 

Traditional  approaches  to  the  human - compute r  interface  have  proven  largely  in- 
adequate  for  achieving  the  multiple  objectives  outlined!  above.  On  the  one 
hand,  automated  sensor  and  e oiWruniCat i on  systems  have  amplified  the  volume  of 
data  available  to  users  without  providing  significant  assistance  in  the  inter¬ 
pretation  of  that  data  and  in  itt  Use  for  the  decision-making  process.  On  the 
other  hand,  expert  systems  and  decision  aids  which  have  been  mere  recently 
proposed  have  gone  Co  the  other  ejttrcme,  by  offering  a  Single  rigid  approach 
to  an*lyaii  and  decision  making,  Few  current  systems  have  attempted  to  deal 
in  a  flesciblt  meaner  with  the  diversity  of  decision-making  situations  in  reol- 
world  combat  environment*  and  the  variety  of  user -preferred  problem -solving 
and  dee is ion- making  styles.  Our  goal  has  been  to  sketch  the  design  of  an 
Adaptive,  highly  flexible  user  interface  to  implement  Che  inference  oechanltrtS 
described  iti  the  previous  sect tone.  The  g&el  i*,  ultimately,  to  product  an 
u id  tliut  i?  both  personalized  in  the  sense  that  it  act<w**odete$  a  variety  of 
user- preferred  knowledge  representations  and  info  neat ion 'processing 
strategies,  and  prescriptive,  in  the  sense  chat  it  encourages  and  in  some 
cases  prompt*  user  actions  that  overcome  deficiencies  in  the  user 'preferred 
approach. 

Ac  Che  highest  level,  Che  cognitive  interface  between  a  user  and  a  computer- 
based  decision  aid,  such  as  ARR,  can  be  characterized  by  five  generic  func¬ 
tions  (see  Cohen,  Thompson,  and  Chlnnie,  19S5J  L 

m  Select i  Users  may  personalise  displays  of  information  by  organizing 
them  around  alternative  meaningful  user- designated  objects  (a, g, , 
time  periods,  spatial  regions,  options,  components  of  options,  at - 
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tributes  -of  options),  The  user  can  examine  any  significant  input, 
inference  rule  ,  Inta mediate  conclusions,  or  final  result  concerning 
a  given  -object,. 

•  Modify:  The  user  can  alter  values  of  any  database  element  and  im¬ 
mediately  observe  the  impact  on  results  downstream  In  a  chain  of 
reasoning;  users  may  undo  their  modifications  and  restore  the 
original  values;  user  inputs  may  be  at  any  level  of  fuzziness  or 
precisian, 

•  Generate:  Users  may  define  options  at  any  level  of  ahitraotness , 
completeness „  or  precision,  and  with  respect  to  any  time  horizon; 
automatic  option  generation  procedure*  work  within  whatever  con¬ 
straints  s  user  has  provided, 

0  Analyze:  In  the  evaluation  of  Options,  user*  may  examine  predicted 
outcomes  according  to  any  preferred  scheme  (e.f,,  Static  or 
tempo ral/dynamic ;  organizing  information  by  attributes  or  by 
options) h  and  may  order  the  relative  importance  of  different  evalua¬ 
tive  criteria  to  any  degree  of  comp letenesE/intocrplete ness  and  fuz¬ 
ziness  or  precision. 

v  AlirC:  The  system  prompts  a  user  when  events  occur  or  facts  are 

learned  which  Would  play  a  significant  role  in  user- preferred  modes 
of  reasoning  and  organizing  informs t Ion , 

Within  the  constraints  of  the  present  work,  only  a  partial  demonstration  of 
the  user  interface  has  been  implemented.  The  demonstration  system  consists  of 
about  UQ  screens  enbedded  within  a  'Live'  menu  system,  Although  many  of  the 
screens  reflect  the  Output  of  the  inference  algorithm,  others  are  'canned" . 
and  serve  the  purpose  0-f  illustrating  the  interface  design,  in  s  fuller  way 
than  the  inference  rannWni-sm  implementation  itself  permits.  The  screens 
provide  appropriate  displays  for  a  moderate  number  of  uenu  requests,  repre¬ 
senting  a  specific  route  replanning  example.  Input  and  output  operations  for 
some  of  the  live  displays  are  also  operational.  A  user  who  stays  within  the 
broad  boundaries  of  the  example  may,  therefore,  get  a  fairly  good  feeling  for 
the  intended  operation  of  the  aid..  The  resulting  demonstration  system  serves 
several  important  purposes  as  a  design  tool:  by  demonstrating  the  relevant  AI 
inferenoing  technology  in  a  specific  subproblem;  by  providing  a  feel  for  the 
quality  of  the  user -computer  interface  and  an  opportunity  to  validate  its 
effectiveness ;  and  by  serving  ss  an  initial  prototype  to  guide  further 
development  of  the  overall  system. 


5.2  Overview  of  flit  I  a  re  r  fan  n 


Interface  features  of  the  Adaptive  Route  Re planner  are  intended  to  minimize 
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the  attention  user*  must  devote  *  imply  to  operating  the  aid,  Virtually  all 
display?  present  information  graphically,  by  a  combination  of  maps  and  charts r 
All  user  inputs  are  by  means  of  a  single  input  device,  which  implements  a 
pointing  function.  In  the  present  demonstration  this  device  is  a  mouse  and 
m&sociated  function,  keya r  In  a  final  cockpit  implementation  however,  the  in¬ 
put  device  might  involve  touching  a  screen,  eye  movements,  or  any  functionally 
equivalent  method. 

The  Adaptive  Route  Re planner  main  menu  Includes  the  following  items: 

SITUATION  RECOMMEND  POSSIBILITIES  REASONS  CRROmUTV  LETHaLITV  ACCEPT 

SITUATION  provide*  the  pilot  a  basic  view  of  the  current  tactical  environment 
(Figure  5-1)  .  In  the  present  deitone tratlon.  It  displays  threat  danger  con¬ 
tours  which  integrate  all  available  information  about  threat  locations,  threat 
IDs,  threat  capabilities ,  and  terrain,  (In  the  demonstration  system  the 
derivation  of  these  contours  takes  place  in  a  "black  box"  and  is  represented 
by  canned  Screens.  Technically,  such  contours  represent  the  differential 
change  In  the  probability  of  destruction  for  an  aircraft  at  the  given  location 
for  a  specified  period  of  time.  In  a  completed  implementation,  the  user  would 
have  the  additional  capability  of  calling  up  displays  which  dnpict  threat 
location  uncertainty,  ID  uncertainty ,  capability,  and  terrain.)  The  Situation 
display  also  shows  the  current  route  and  tlie  location  of  the  aircraft  on  that 
rout* . 

When  A  pcp-up  threat  occur*,  the  Situation  display  provides  critical  informa¬ 
tion  t Figure  5-2).  The  display,  however „  minimises  the  Information  processing 
burden  on  User*  by  (a)  alerting  with  regard  to  such  a  threat  only  when  it  mat¬ 
ters  £i„e.  ,  when  the  increase  in  lethality  of  the  current  route  due  to  the  new 
threat  exceeds  a  preset  threshold)  ;  (t)  using  displays  that  emphasise  changes 
from  the  expected  situation:  i.e. .  areas  where  danger  has  increased  due  Co 
the  pop-up  threat  by  x  percent  or  more  arc  Mgbli^ited  in  red;  and  (c)  prompt¬ 
ing  users  only  in  regard  to  these  uncertainties  in  the  evidence  that  are 
critical  for  the  decision-making  task  (see  below) , 

After  the  occurrence  of  a  pop-up  threat  has  been  indicated  by  the  aid,  the 
ujer  ha*  several  alternative  courses  of  action  available,  (1)  He  may  select 
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DATA:  Hilar  sLgna]  it  ieuinp  -  1334,,  lift  it  36*  Lin),,  42*  tit, 
S-jurcf'.  SIT!  Sfa.'sng;  Hr*  Tlrrit 


Figure  5 “2 


RECOMMEND,  and  the  aid  will  automatically  a  route  which  aecetwttodatfcs 

the  new  Informatlpp  About  the  pop-up  threat  {Figure  &-3);  (2>  he  par¬ 

ticipate  In  the  touts  generation  process  by  providing  input*  which  constrain 
the  reuses  generated  stid  rocoranjctldad  by  the  aid  (thl*  capability  haa  not  been 
demons tented  in  the  present  system)!  (3)  h*  tfey  explore  in  greatet  detail  the 
lines  0-f  reasoning  underlying  the  SITUATION  display  and  the  route 
tetoasnendaticn. 

Option  (3)  is  ImpLeoenced  by  the  ftFAS-DNS  and  the  CREDIBILITY  displays, 

REASONS  aa  shown  In  Figure  5-4  displays  the  rasln  alternative  hypotheses  for 
interpreting  the  current  data  about  the  pop-up  threat.  In  particular,  in  this 
e 5tasY.pl e  a  EAR  signal  has  been  received  by  the  aircraft  and  may  represent  (a)  a 
new  signal  from  a  previously  identified  stationary  threflt,  (b)  a  new  signal 
from  a  previously  Identified  threat  which  has  moved ,  or  (o)  a  signal  from  a 
previously  unSuiown  threat.  The  REASONS  display  shows  the  relative  strength  of 
each  of  these  hypotheses  given  the  available  evidence,  resulting,  from  applica¬ 
tion  of  ARR's  inference  mechanism. 

Perhaps  more  importantly,  beneath  each  bar  in  thia  histogram  Is  a  H  ledger*  (P, 
Cohen)  of  reasons  for  or  against  that  particular  hypothesis.  Thus,  for 
example,  support  for  the  hypothesis  that  the  EAR  signal  represents  a 
stationary,  previously  identified  threat  might  come  fromE  the  high  overlap  In 
location  contours  represented  by  th*  new  signal  and  by  the  previous 
led  all 2 atidrt,  intelligence  Assessments  which  indicate  a  low  mobility  for  the 
threat  type  Involved,  or  a  high  assessment  of  the  thoroughness  of  prior  area 
intelligence.  Similarly,  possible  reasons  in  support  of  the  hypothesis  that 
the  signal  represents  a  moved  threat  include i  relatively  low  overlap  in  the 
location  edntours  for  the  two  localizations  t  high  confidence  In  the  thorough¬ 
ness  of  ptiot  area  Intelligence,  and  an  intelligence  assessment  that  the 
relevant  threat  type  does  possess  the  requisite  mobility.  Finally,  reasons 
that  might  support  the  possibility  that  a  new  threat  has  emerged  in  the  area 
include;:  low  confidence  in  the  exhaustiveness  of  prior  area  intelligence  and 
a  distance  between  the  two  signals  which  conforms  with  our  understanding  of 
enemy  siting  practice.  The  BEA501T5  display  automatically  indicates  which  of 
these  possible  reasons  have  in  fact  Influenced  the  evaluation  of  the  new 
s i gnal * 
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Figure  5-4 


L£  he  uiihes,  the  user  may  *xplore  in  «ven  teeter  depth  the  line  of  reasoning 
which  le^d  to  the  torrent  situation  assesament,  Ha  may  do  thi*  by  select i^g 
the  CREDIBILITY  screen  {Figure  5-5).  CREDIBILITY  displays  *  hie  (egrets  which 
represents  the  degree  of  credibility  or  confidence  in  the  sources  of  evidence 
underlying  the  REAOOtfS  screen.  Thus  In  the  present  example  evidence  is  avail¬ 
able  from  a  prior  localization  based  on  HUMlWT,  a  new  signal  from  SAR,  and 
three  different  types  of  specific  intelligence  (concerning  threat  siting, 
mobility,  and  thoroughness  of  intelligence  coverage). 

In  addition  to  indicating  a  degree  of  credibility  for  each  of  these  sources , 
however,  the  CREDIBILITY  screen  shews  the  qualitative  basis  for  such 
credibility  judgments  in  a  highly  natural  way,  in  the  form  of  positive  and 
negative  "'endorsements"  {P. Cohen).  Under  each  bar  of  the  histogram  is  a  set 
of  credibility  factors  which  influence,  either  positively  of  negatively,  our 
confidence  In  the  relevant  source. 

The  Adaptive  Route  Planner  allows  the  uacr  to  modify  Inputs  or  intermediate 
values  at  any  level  of  analysis,  Thus,  the  user  way  modify  the  degree  of 
belief  in  the  hypotheses  represented  in  Figure  5-4,  the  degree  o4  credibility 
assigned  to  different  sources  in  Figure  5-5,  or  the  status  of  credibility  fac¬ 
tors  shown  in  the  lower  part  of  Figure  5-5.  (Chily  the  latter  two  have  been 
implemented  in  the  present  demonstration. )  In  each  case,  the  results  of  the 
adjustment  are  reflected  in  automatic  inferences  farther  downstream  in  the 
reasoning 

For  example,  the  pilot  may  feel  greater  (or  Lesser)  confidence  in  the 
reliability  of  SAP  evidence  than  does  the  automatic  inference  process,  If  so, 
he  may  adjust  the  credibility  assessment  simply  by  pointing  to  the  desired 
height  on  the  histogram.  Alternatively,  the  user  may  have  information  regard¬ 
ing  a  specific  credibility  factor.  In  that  case,  he  may  adjust  the  statue  of 
the  credibility  factor  (which  in  turn  will  have  an  automatic  effect  on  the 
heights  of  the  histogram).  For  example,  if  the  aid  indicates  a  high  ground 
reflectance  (based,  for  example,  on  DMA  maps),  hut  the  pilot's  direct  observe^ 
tton  Indicates  law  reflectance,  he  may  alter  this  factor  by  pointing  t& 
reflectance,  cycling  through  a  set  Of  value*  ( including  low,  moderate,  high, 
apd  unknown)  ,  and  selecting.  Similarly  he  may  adjust  ECU  (unlikely ,  possible, 
probable.  and  unknown) ,  ueather,  and  so  on.  As  cheje  credibility  factor 
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assessments  are  changed ,  the  degree  of  support  for  relevant  hypothec*  In 
Figure  5-4  la  adjusted  automatically , 

Up  to  tills  point,  we  have  discussed  the  pilot's  ability  to  explore  (and  to 
participate  In}  an  inference  task  I re, +  determining  the  nature  and  extent  of 
the  pop-up  threat,  Eut  the  pilot  may  also  be  concerned  CO  evaluate  the  effeC- 
tlveuess  of  a  recommended  route  revision.  For  this  purpose,  h*  may  select  the 
LETHALITY  a c.re an  (Figure  5-6).  This  screen  provides  *  representation  0-f 
lethality,  i.e.,  probability  of  own  aircraft  loss,  as  a  function  of  time  on  a 
particular  route.  The  two  curves  in  Figure  5-6  represent  the  current  route 
and  the  recommended  route  revision,  respectively.  Each  curve  is  cumul at ive , 
showing  how  the  risk  on  a  route  increases  with  time  on  that  rout*.  The  final 
level  on  the  ordinate  for  each  route  represents  to Cal  chance  o£  own  aircraft 
destruction  on  that  route.  The  slope  on  any  given  portion  of  a  Curve  indi¬ 
cates  the  local  danger  In  that  portion  of  the  route;  steeper  portions  of  the 
curve  representing  more  dangerous  areas  and  shallow  portions  of  the  curve  rep¬ 
resenting  less  dangerous  sreas.  I  and  T  represent  the  initial  point  and  the 
target,  respectively,  on  each  route.  Generic  symbols  representing  SAMs, 
radar,  and  artillery  sites  on  these  curves  are  keyed  to  corresponding  symbols 
in  the  situation  display. 

At  any  time  the  user  can  indicate  his  acceptance  of  a  route  (either  a  retoa- 
aended  route  or  one  generated  by  bis  own  inputs)  by  selecting  ACCEPT.  When  he 
does  so,  the  accepted  route  becomes  the  new  "current  route11  in  all  future 
displays. 

It  is  inevitable  that  in  many  warfare  situations,  the  available  evidence  will 
bo  intomplet-e  or  conflicting ,  or  both.  Aft  disCufised  abo-ve,  the  present  in¬ 
ference  ncchanisra  design  is  tailored  to  deaL  with  those  contingencies  in  A 
highly  adiiptlvu  fashion.  The  interface  design  likewise  in  Intended  to 
facilitate  user  understanding  And  effective  response  to  such  contingencies. 
Figure  5-7  shows  a  SITDATIQH  display  in  which  Significant  inconsistency  among 
sources  of  evidence  has  been  indicated.  The  nature  of  the  inconsistency  is 
briefly  summarized:  the  SAR  signal  may  represent  the  presence  of  a  new  threat 
or  it  may  originate  from  a  previously  identified  stationary  threat, 

Th*  inconsistency  prompt  occurs  only  when  tbe  system's  autonated  processes  of 
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Figure  5-7 


inference,  conflict  resolution,  and  sensor  redeployment  have  failed  thut  far 
to  resolve  the  conflict.  In  effect,,  It  represents  a  test  for  Che  presence  of 
a  discount  factor  which  treats  the  user  as  a  potential  source  of  information. 
This  prompt  alerts  the  user  that  he  nay  possess  information  which  natters  in 
the  resolution  of  the  conflict.  Such  prompts  do  not  occur  trivially.  Their 
occurrence  is  date rained  (as  we  have  seen  above)  by  a  comparison  of  the 
utility  of  the  test  (i.e.h  the  information  that  may  be  possessed  by  the  user) 
with  the  cost  of  requesting  that  information.  The.  estimate  of  cost  should,  in 
principle,  be  highly  sensitive  to  the  current  prevailing  workload  and  time 
stress  on  the  pilots  It  should  reflect  the  cost  of  diverting  the  pilot  from 
other  tasks  i  as  well  as  the  system -computed  time  remaining  until  a  decision 
regarding  the  pop-up  threat  must  be  cade.  In  ARR,  therefore,  the  degree  of 
huuan  interaction  will  vary  automatically  with  circumstances .  (Note  that  even 
when  he  has  been  prompted,  the  user  may  decline  to  respond.  In  that  case,  the 
automated  conflict  resolution  process  will  resume,  for  example ,  by  proceeding 
to  a  higher  co-st  test  ot  to  the  phase  of  overall  discounting, L ) 

In  the  time-stressed  cockpit  environment,  under  conditions  of  conflicting, 
evidence,  the  CREDIBILITY  screen  directs  the  pilot's  attention  to  those 
assessments  (a)  about  which  he  is  likely  to  have  some  information,  and  (b> 
which  are  likely  to  have  the  most  impact  on  conflict  resolution.  Credibility 
factors  which  satisfy  these  criteria  are  highlighted, 

lender  conditions  -of  inconsistent  evidence,  the  SITUATION  display  serves  a  dual 
purpose:  (1)  It  prompts  the  user  regarding  the  conflict  (if  appropriate),  and 

indicates  the  nature  of  the  conflict  (in  yellow)  on  the  spatial  display;  (2) 
at  the  same  time,  however,  its  primary  purpose  remains  the  display  of  an  ag¬ 
gregated  set  of  danger  contours  incorporating  all  relevant  information.  Thus, 
It  do$3  not  provide  a  vivid  or  concrete  picture  of  the  Implications  of  the 
conflict  to  the  pilot,  Similarly,  the  REcQMtf ENDED  display  provides  a  route 
revision  which  incorporates  *11  currently  available  information.  That  ip, 
this  ia  the  "-Compromise"  route  considered  Optimal  hy  th*  aid  under  the  condi¬ 
tion  that  no  further  information  (which  might  resolve,  the  conflict)  ver*  to  ha 
obtained.  If  ha  chooses  however,  the  user  may  examine  in  a  "what-lf”  fashion 
various  ways  in  which  the  conflict  might  be  resolved  and  their  implications 
for  route  selection.  Thus  by  selecting  POSSIBILITIES ,  he  may  view  alternative 
conflict  resolutions.  For  example ,  screen  5- B  shows  danger  contours  which 
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would  exist  i£  ve  vert  to  assume  that  the  correct  interpretation  of  the  new 
SAS  signal  involves  a  previously  unidentified  threat.  Correspondingly,  Figure 
5-9  shows  danger  con tour a  which  would  exist  were  we  to  assume  that  the  correct 
interpretation  of  a  EAR  signal  Involves  a  previously  identified  threat..  If 
the  user  now  selects  RECOMMEND  under  either  of  these  possibilities,  the  aid 
displays  the  recocnende d  route  revision  which  would  be  appropriate  if  the  cur* 
rently  selected  "possibility"  were  to  be  realised  (Figures  5-10  and  5-H)  , 

By  these  means,  the  user  is  able  to  obtain  a  quick  appreciation  of  the  nature 
of  the  conflict  (i.e.,  hew  his  mental  picture  of  the  tactical  situation  would 
change  under  different  conflict  resolutions)  and  the  implications  of  the  con¬ 
flict  for  his  choice  of  s  route*  Such  a  concrete  representation  of  alterna¬ 
tive  possibilities  is  a  more  natural  representation  of  uncertainty  in  this 
situation  than  the  more  aggregated  (but  equally  necessary)  "compromise"  dis¬ 
plays  provided  by  the  SITUATION  screen..  It  corresponds  to  the  pilot's  desire 
to  think  concretely  about  "what  is  out  there  %  and  yet  at  the  same  time  does 
not  permit  him  to  ignore  the  uncertainty  inherent  in  that  process. 

The  implemented  demonstration  System  focuses  primarily  on  the  resolution  of 
conflict  regarding  the  number  and  localization  of  threats.  However,,  the  in¬ 
ference  mechanises  and-  interface  design  are  equally  applicable  to  conflict  of 
evidence  in  virtually  any  inferential  problem.  Figure  5-L2  illustrates  a 
SITUATION  screen  in  which  conflict  regarding  the  ID  of  a  threat  is  indicated. 
In  this  case,  the  REASONS  screen  (Figure  5-13)  shows  the  relative  support  for 
various  IT)  possibilities  (SA-2,  5A-4,  etc,)  and  indicates  the  reasons  which 
confirm  or  dtsconfirm  each  possibility,  similarly,  CREDIBILITY  indicate  fac¬ 
tors  which  influence  the  credibility  of  each  source  of  evidence.  The  POS¬ 
SIBILITY  screens  (Figures  5-14  and  .5-15)  show  the  implications  in  terms  of 
danger  contours  for  each  possible  resolution  of  the  conflict,  and  RECOMMEND 
shows  the  implications  for  route  selection. 

A  somewhat  different,  but  equally  appropriate,  use  of  the  J^jresent  interface 
design  is  for  in-flight  vetasktng,  Figure  5-1.6  illustrates  a  SITUATION  screen 
ts,  which  the  Aircraft  has  been  Instructed  to  engage  a  different  target,  and 
Che  pilot  has  used  RECOMMEND  CO  request  AftR  to  provide  a  recommended  route 
r avi s i on . 
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6.0  COHCLJUSIOHS  AND  DIRECTIONS  FOR  FUTURE  RESEARCH 


Development  of  an  adaptive  self -revising  inference  entitle  for  handling  uncer¬ 
tainty  can  make  a  significant  contribution  to  the  technology  of  decision 
aiding  In  teal- time  tactical  environments.  The  research  described  above  has 
demons  Crated  the  feasibility  of  such  a  concept.  It  has  produced!  a  design  for 
expert  systems  inferencing  with  very  wide  applicability.  Id  virtually  all 
problem  solving  domains  where  expert  systems  technology  might  be  introduc ed „ 
there  is  need  for  explicit  and  valid  quantitative  modeling  of  uncertainty,  At 
the  same  time,  there  Is  need  for  a  me ta s true  tune  of  qualitative  reasoning  in 
which  the  assumptions  utilised  In  the  probability  nod el  are  reassessed  and 
revised  In  the  course  of  the  argument.  These  are  the  dual  requirements 
addressed  by  the  inference  framework  described  in  Section  3-  and  implemented  in 
the  system  described  in  Sections  4  and  5  above* 

The  next  logical  step  In  this  research  Is  to  go  beyond  the  prototype  systeia 
described  In  Sections  A  and  j,  to  the  development,,  imp  1  ementation t  and  testing 
of  a  completed  system  for  in-flight  route  replanning.  The  resultant  system 
should  have  Immediate  relevance  Co  current  Air  Force  efforts  to  introduce 
highly  promising  new  technologies  into  aircraft  avionics. 

Successful  development  of  iuth  a  system  would  have  repercussions  going  well 
beyond  the  specific  application  of  in-flight  route  replanning.  Together  with 
the  theoretical  framework  described  above  the  successful  implementation  of  a 
completed  system  would  result  in  the  existence  of  a  powerful  technology  for 
the  building  of  expert  systems  in  a  wide  variety  of  domains.  'What  is  learned 
ip  this  application  could  be  applied  In  much  greater  general ityN  enabling  the 
building  of  systems  capable  of  accommodating  uncertainty  both  at  the  level  of 
probabilistic  reasoning  and  at  the  level  of  qualitative  testing  and  revising 
of  assumptions. 

A  completed  in-flight  route  replanning  system  would  require  further  refine¬ 
ments  In  the  design  and  algorithms  implemented  in  the  prototype  system 
developed  during  the  present  effort.  Particular  developments  needed  are  the 
exploration  of  more  general  forms  of  discounting,  alternative  ways  u£ 
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prioritizing  Information  search*  more  general  senior  management  and  user  in- 
to roe tl on  capability*  ns  wall  as  other  refinement*.  In  all  of  those 
ref  inements  f  the  « In,  is  to  implement  the  inference  mechanism  in  as  modular  a 
fashion  as  possible  and  as  independently  as  possible  from  specific  domain 
knowledge.  Such  an  effort  wood!  result  in  a  genetically  useful  export  systems 
building  tool,  suitable  for  a  wide  variety  of  applications  domains. 

Another  crucial  feature  of  expert  systems  implementation  ia  the  incorporation 
of  expert  knowledge  into  the  system.  Despite  its  Importance,  knowledge 
elicitation  continues  to  be  an  ill-defined  and  eclectic  art  which  demands 
enormous  amounts  of  time  from  both  computer  scientists  and  domain  specialists. 
Another  promising  avenue  for  other  research,  therefore*  is  an  exploration  of 
the  implications  of  our  inference  framework  for  knowledge  elicitation,  both 
specific  to  the  in-flight  route  replanning  application*  and  more  generally 
across  application,  domains . 

The  inference  framework  developed  under  this  research  may  contribute  in  three 
different  ways  to  progress  in  au tuna ting  and  streamlining  the  knowledge 
elicitation  process.  First*  our  framework,  by  allowing,  the  building  of 
adaptive*  self  ■- Improving  systems,  already  provides  mechanisms  for  learning  and 
altering  the  systems  reasoning  mode  In  changing  Onvl ronnents .  Second,,  by  of¬ 
fering  a  highly  structured  framework  for  representing  knowledge  and  manipulat¬ 
ing  arguments,  it  provides  a  type  of  Support  for  the  knowledge  elicitation 
process  not  afforded  by  other  expert  system  frameworks,  Finally,  it  may  form 
the  eventual  baa is  of  an  automated  knowledge  elicitation  tool  which  applies 
and  reconollti  multiple  methods  of  eliciting  expert  knowledge. 
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